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FOREWORD 



No project in the 15-year history of the Adult Basic Education Program has had more 
widespread and rapid impact than the Adult Performance Level (APL) study. APL began in 
1971 with support from the Adult Education Division of the U.S. Office of Education (USOE). 
By the time the final report from this study was issued in 1977, two-thirds of the states had 
already decided to implement some form of competency-based adult education, almost all of 
them based on the APL findings. Within the next 3 years, seven major state- or national-level 
studies had refined, expanded, modified, and left relatively intact the APL's Identification of 
the range of competencies for adult life. Curriculum materials. originally developed through the 
project are now available commerically. 

The APL project included a series of activities. The first was the identification of com- 
petencies required to function in society. The second was an assessment of the levels of com- 
petence among the American adult population. The third was the development of curriculum 
materials and guides for adult competency-based education programs. In addition, the Adult 
Education Division sponsored national and regional workshops to inform state administrators 
and practitioners about the APL process and findings. 

The two papers in this volume look at the APL from different perspectives. Joan Fischer 
examines the substance of the APL-identified competencies In relation to 11 other efforts to 
identify adult competencies— two of which preceded APL. Fischer's paper looks at the first 
stage of the APL process— the identification of competencies that are proposed as encompass- 
ing the performance demands of some segment of adult life. She cautions the reader to 
understand that the sponsors and directors of this kind of effort are faced with many decisions. 
How these are made and what these judgments are will profoundly affect the substance of 
competency identification and the determination of which ones will be proposed as essential to 
success or survival. 

She then reviews 12 competency identification efforts at the national or state level: the 
original two APL lists of competencies, five that were built directly on APL, and five that were 
not limited to the APL framework, although they overlap substantially with APL. Two of the 
latter were actually conducted prior to the APL project. Her descriptions illustrate how these 
critical judgments were made and the surveys of need conducted. 

In the final section of her paper, Fischer presents an extensive Summary of Competen- 
cies. Using the APL listing as a baseline, she identifies those that other studies have determined 
to be important, as well as the degree of variation between the APL's list and the others. For 
those studies that were not limited to the APL list, the additions are also presented. 
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The 1978 changes in the Federal Adult Bas.. ,n law place greater emphasis on 

teaching the eligible population those skills and abii; c are necessary for functioning in 

adult life. It is likely that many programs will want to ic t-.e lists of competencies that will 
be integrated into their programs. Our intention in this pa. jr is to illustrate that much of this 
work has already been done. While variations should he expected, depending on local con- 
ditions and student needs, program developers and utructors need no longer start from 
scratch. The substantial work of these 12 studies offers - ,i extensive resource to competency- 
oased adult education progrartis. 

Walter Haney and Lloyd David look at the phenomenal spread of the APL concept and 
rnaterials as a central event in the evolution of adult basic education programs In this context 
they also review some major criticisms of APL that illustrate the pitfalls of designing and im- 
plementing competency-based education programs. 

After reviewing the history of the original APL effort, they scrutinize the conclusions of 
tive major APL critics and add a few of their own. Their analysis emphasizes the impact of 
these criticisms on judgments about the validity and scientific quality of the study They are not 
pleased with what they find. In effect, they and the others question many of the decisions and 
judgments that Fischer has outlined as critical in the competency identification process. 

They then turn to the spread of APL to state and local programs and the development of 
curriculum materials for Adult Basic Education classes. They conclude that a variety of factors 
have contributed to this evolution, including USOE's sponsorship of developmental efforts to 
irriplement APL-based changes and the perception by adult educators that the APL framework 
offered a valuable and much needed alternative to traditional adult basic education. 

They conclude that the value of APL has been its contribution to broadening the concep- 
tions of how adult basic education can be organized and to enriching the body of curriculum 
materials on which adult educators can draw. However, they warn against the use of the paper 
and pencil multiple- and limited-choice format as a way of assessing "functional competence" 
and identifying an individual's level of competence. Such procedures they feel are too fixed 
and rigid for these purposes. More fundamentally, they question the plausibility of searching 
tor any one set of knowledge and skills with which to define overall adult competence in a 
society as variegated and pluralistic as modern America. 

ADt paper is not to open the wounds of criticism that have surrounded 

APL although this is a danger. APL was a constructive, sincere effort by both research and 
development and program professionals to make systematic improvements in a system that 
many perceived was not effective. Working against an established view of the programs and 
seeking to find ways to guide some fundamental changes, it is not surprising that the results are 
imperfect and that critics will expose these imperfections to view. Rather, we seek to inform 
adult educators about the critical issues that are involved in developing competency-based 
education programs and to examine the process of diffusion and implementation of materials 
that might bring about constructive changes in a much needed program. 

This report is one of several being pubushed under the auspices of NIE's Adult Learning 
Team, Education in the Home, Comnr unity, and Work Unit, Program on Teaching and 
Learning. A second is The Adult Illite'aie Speaks Out by Anne Eberle and Sa.idra Robinson 
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The third is Adult Development and Approaches to Learning, with contributions by Harry 
Laskcr and James Moore cn "Cuncnt Studies of Adult Development: Implications for Educa- 
tion," and by Edwin L. Simpson on "Adult Learning Theory: A State of the Art." 

Further information about the Institute's research program in adult learning can be ob- 
tained from Jerome Lord, Adult Learning Team, National Institute of Education, 1200 19th 
St. NW, Washington, D.C. 20208, (202) 254-5706. 



Robert W. vStump 
Senior Associate 
National Institute of Education 
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COMPETENCIES FOR ADULT 
BASIC EDUCATION AND DIPLOMA 

PROGRAMS: A SUMMARY OF 
STUDIES AND CROSS-REFERENCE 
OF RESULTS 



In February 1978, the U.S. Office of Education sponsored an invitational workshop on 
adult competency education. A summary of the research and activities relevant to compe- 
tency-based adult education was presented and later published (Fischer, 1978). A second 
paper briefly reviewed additional efforts for a National Invitational Workshop on Competency- 
Based Adult Education (Fischer, 1979). In both cases, a number of the surveys and studies 
were still in progress, and final results not yet available. This cunent paper is based on the com- 
pleted projects. Its purpose is to update and analyze in greater detail these efforts to identify 
competencies necessary for adult functioning and to summarize competencies from the 
various studies. 

1. Identification of Competencies 

In the last few years, studies of the necessary competencies for adults have concentrated 
on those related to functioning successfully outside of school— a reaction to the emphasis on 
basic reading, math, and grammar skills within our Adult Basic Education and high school 
equivalency programs and an attempt to alter at least the context of that instruction, if not the 
entire curriculum. 

Identifying competencies necessary for successfully canying out adult responsibilities is a 
complex process involving a series of decisions. Either directly or indirectly, the program 
developers make decisions regarding: 

•What are the competencies? 

•What level or standard of performance indicates competence? 
•Which competencies are truly necessary? 
•On what criteria should decisions of necessity be based? 
•How should competencies be stated? 



If the procedure selected involves surveying people, additional decisions include: 
•Who should be surveyed? 

•Should the survey be of a questionnaire type or an assessment instrument? 

•How are the competencies transposed into questionnaire or assessment items? 

•If a questionnaire is used, what is the best way of phrasing the question to the 
respondents so that the response is valid? 

Throughout the process of competency identification, judgments are made that reflect the 
influence of such factors as the individual or organization that is conducting the study the 
funding agency, the amount of money available, and the availability of desired information In- 
vanably, subjective judgments enter into and affect the final results. These are most obvious in 
a comparison of the competency domains and the items of the questionnaire or assessment in- 
strument. These decisions are open to criticism by those who disagree with them or see 
weaknesses in their implementation. In reviewing these studies or any others, the reader 
should keep in mind the purposes, perspectives, and procedures used in order to understand 
accurately the results and the comparison of the various efforts. 

One of the earliest, and probably the most visible, effort to identify adult functional com- 
petencies was the Adult Performance Level (APL) project funded by USOE and conducted by 
the Texas Education Agency and the University of Texas. This project became a point of 
departure for manV others who have sought to replicate or expand on the APL lists. 

Reactions to the APL listing varied. While some adult educators readily accepted the 
listing, others questioned the procedures (Griffith and Cervero. 1976) and asserted that the 
statenients and items were value laden and/or limited. These reactions are reflected in the ap- 
'L'"^*™ ^ In some cases, other researchers sought to determine which of 

u AoT students most needed. Other studies sought to go beyond or expand 

the APL listing. The APL work, however, is still a primary influence on other research 
whether or not the premise and results are accepted. 

This review of competency identification studies focuses on: (1) studies that were limited 
to reactions to the APL listing; and (2) studies that were not limited to APL. The reviews of 
both types of studies emphasize the procedures used to identify competencies In both cases 
only studies that produced listings of competencies based on substantial representations of sub- 
jects have been included; studies that are limited to one program or community have not been 
included. 



2. The APL Study 

Although the APL work has been reviewed extensively in other articles, its importance as 
a major effort in studies to determine competencies merits its inclusion in this review The APL 
research was initiated by USOE to stimulate development of curriculum specifically designed 
for adults. The project had three objectives: 

•To determine the basic requirements of adult living. 

•To determine the basic performance criteria associated with these requirements. 

/ 
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•To develop, field test, and administer an instrument that would identify levels 
competency. 

The first objective was accomplished by: (1) reviewing behavioral and social research to 
categorize the needs of undereducated and underemployed adults: (2) surveying state and 
Federal agencies and foundations to identify characteristics that distinguished successful from 
unsuccessful adults; (3) conducting a series of regional conferences on adult needs to which 
adult educators, representatives from the private sector, and persons from state and Federal 
agencies were invited; and (4) interviewing undereducated and underemployed adults. The 
project staff arrived at the concept of functional literacy that included the five knowledge and 
four basic skills areas identified on figure 1. The range of skills included led the researchers to 
drop the term "functional literacy" in favor of "functional competency" (Adult Performance 
Level Project Staff, August 1977). 



FIGURE 1 
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• Several concepts are integral to the APL definition of functional competency: 

•Functional competency is meaningful only in a specific context. Recognizing the dif- 
ferences among various subpopulations, the researchers chose to "create a single in- 
dicator" that was common to most people in the United States. 

•Functional competency entails the application of skills to the five general knowledge 
areas and is a function of individual skills ^nd social requirements. 

•Functional competency is directly related quantitatively to success in adult life. This 
assumption led the researchers to adopt an index of success that was a composite of 
income, level of education, and occupational status. 
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Though the lack of full documentation of the background research leading to the lists of 
competencies and the use of the selected success indicators have been criticized, the APL list 
of competencies and the survey have provided a basis for modifying ABE curriculum and pro- 
cedures. Sevei.-^l lists of competencies have been issued by the project. The most widely 
distributed and quoted are the 65 general APL objectives. The more recent listing of 41 , which 
is the basis for the teaching modules developed by the APL staff, grew from curriculum writing 
efforts rather than from additional research. In compiling the latter, the staff tried to eliminate 
some of the duplication across objectives (APL Project Staff, 1976; November 1977), 

The format for stating the APL competencies consists of a general goal statement, in- 
termediate objectives, and enabling or task objectives. These levels of objectives have been 
designated unit objective, end behaviors, and learning steps. Theoretically, if an individual can 
perform each of the learning steps, that person has mastered the unit objective and is compe- 
tent in that area. Each objective involves tasks for using reading and other communication 
skills, computation, interpersonal relations, and problem-solving skills. 

Some APL competency statements are more specific than others: for example, ''to be 
aware of advertising techniques" vs. "to be able to count and convert coins and currency"; ''to 
be aware of various aspects of self and to use this to promote personal growth and effective in- 
terpersonal coping" vs. "to prepare for job applications and interviews." This variation in the 
phrasing of competencies is not unique to APL. It reflects the difficulty of stating various com- 
petencies, some of which may be relatively straightforward while others are more abstract. The 
degree of specificity of competency statements affects the determination of standards for 
demonstrating possession of those competencies. Standards and component behaviors for less 
concrete competencies are subject to greater variation and value interpretations. 



3. APL-Based Validation Studies 

Studies designed primarily to determine the appropriateness of the APL list of competen- 
cies to ABE populations were conducted in New Jersey (two efforts), USOE Region X, Penn- 
sylvania, and Alaska. These studies primarily assessed student need or interest in response to 
statements drawn from the APL list of major or enabling objectives. Frequently, only some of 
the APL statements were used, and these were paraphrased from the original APL statements. 

New Jersey Adult Basic Education Study 

To determine the appropriateness of the APL objectives for New Jersey native born and 
English as a Second Language (ESL) ABE students, two studies were conducted. Flaherty 
(1977) interviewed English-speaking ABE students to determine their self-perceived needs 
and interests. Forty-two statements were selected to reflect the five APL knowledge areas. 
Although the process for selecting the particular statements used was not described, emphasis 
was placed on statements that would be brief and understandable by ABE students. 

Generally, many of the competency sjatements included in this study could be viewed as 
subcomponents of the APL unit objectives rather than as a reflection of the total scope of ob- 
jectives. For example. "Filling Out an Income Tax Form" and "How the Court System 
Works" (the APL statements) are not synonynious with "To Understand the Concept of 

6- 
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Income Tax'* and "To Understand the Court Systems and How to Use the Legal System in 
Order to Protect Your Rights and Possessions" (the terms used by the survey). 

A preliminary interview schedule was field tested and revised to construct the final 
27-page questionnaire. For each statement, the respondents were asked: "Do you want to 
learn this skill in your ABE class this year?" "How much do you already know about that skill?" 
"Do you think it's necessary, helpful or just interesting for you to learn?" One competency for 
each of the five knowledge areas was probed in greater depth. The interview also included 
open-ended questions to ascertain additional skills desired and the priority of these desired 
skills. 

The survey population included only students participating in ABE basic skills instruction. 
Twenty programs were randomly selected to represent programs of different size. Ten students 
present at the time of the scheduled site visit were interviewed. The final sample of 204 proved 
to be generally representative of the total ABE population, particularly of those in the Atlantic 
shore area. Based on the results of the APL test instrument, these respondents had a below 
average mean score. The instrument used was the American College Testing Program's revi- 
sion of the original APL test. 

Student responses for interest in learning and necessity of learning a competency were 
related. However, in all instances, a greater percentage of respondents were interested in 
learning a competency than felt it necessar\; to learn it. Though over 50 percent showed an in- 
terest in learning skills associated with occupational knowledge, government and law, con- 
sumer economics, and health, the percentages who felt it necessari; to learn those areas were 
40 percent, 38 percent, 37 percent, and 28 percent, respectively. Ratings of respondents dif- 
fered noticeably when race, urbanism, readirg ability, age, and chief wage earner's income 
were considered. 

In spite of the positive interest in learning APL areas, when asked why they enrolled in the 
program only 5.4 percent stated a reason related to life-coping skills. Students expressed 
greater direct interest in instruction related to the basic skills and specific vocational skills than 
in general APL topics. Flaherty thus concluded that although New Jersey students were in- 
terested in learning competencies, basic skills were a higher priority. The difficulty with this fin- 
ding, which is not uncommon in competency-based research, is that no one is sure that the 
respondents distinguish between basic skills (reading, writing, oral communication) and basic 
competencies (the application of these skills and appropriate knowledge to situations they face 
in their lives) . 

New Jersey English As a Second Language Study 

A second study was conducted in New Jersey to ascertain APL topics of greatest interest 
and importance to ESL students in ABE programs in the northern part of the State (Bodman 
and Lanzano, 1978). The intent of the study wais to help teachers select meaningful contexts 
for ESL instruction. To keep the questionnaire to a reasonable length, only two APL content 
areas— occupational knowlege and consumer economics— were included. A 66-item ESL 
questionnaire was translated into 18 different languages to ensure that it would be understood 
by students of the different language backgrounds in the area. 



Students were asked to respond to each of the 66 topics by rating their interest in and the 
importance of each. For both interest and importance, students had six options that included 
"no opinion," "don't understand/' and "know enough." A "free response" section allowed 
students to indicate additional topics of interest or importance to them, what they found most 
difficult to learn when they first arrived in the United States, and what activities were the most 
different for them in this country. 

The majority of the responses (359 out of 453) were from Spanish-speaking students. An 
additional 57 were Japanese, and 37 were Polish speakers. Although demographic data were 
collected, there was no indication of how representative the respondents were either of all New 
Jersey ESL students or of those from the counties surveyed. ' 

Responses were analyzed according to these three language groups. As with other 
surveys of this type, ratings of interest and importance were highly correlated. In all three 
groups, ESL students were enthusiastic about learning topics included in the APL study. 
Spanish-speaking students were most receptive to the APL topics, while Japanese and Polish 
students were less responsive. Different groups were also interested in learning different topics. 
Spanish-speakers were most interested in occupational knowledge topics, while Japanese 
respondents ranked five consumer economics items as of greatest interest to them. There were 
also many variations for individual items and among Spanish nationality groups. 

Since Spanish-speaking students comprised the largest group of respondents, the items of 
greatest interest/importance to these students were identified. Four indicators were used: 

•Fifty percent or more respondents judged the topic very interesting. 

•Fifty percent or more judged the topic very important. 

•The mean interest rating was 2.5 or higher (scale of 1 to 3). 

•The mean importance rating was 2.5 or higher. 

The 23 topics listed in table 1 met one or more of the above criteria. 

Spanish and Japanese student responses to "free response" items were categorized and 
are listed in order of frequency for each category in table 2. The most frequently noted free 
response topics relate to learning the English language and the new culture. Other frequently 
mentioned items repeated some of the APL topics (e.g., employment, health care, food, and 
transportation). Some of these, however, were not included on the survey, which dealt only 
with occupational knowledge and consumer economics. Free response items apparently 
tended to relate to specific and immediate student concerns (e.g., "talk to mechanic about 
problems with car"). 

The frequency of life-coping skills topics, along with the English-language and cultural 
topics, could realistically be interpreted to support ESL students' interest in learning both life- 
coping skills and English. Many of the survey items were related to topics (information) , while 
about 15 others involved very specific language behaviors (e.g. , "speaking in a job interview") . 
Life-skills topics can provide ESL teachers a basis for designing instructional content, providing 
wanted information, and/or teaching English language skills. 
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TABLE 1 

NEW JERSEY ESL TOP TWENTY-THREE TOPICS FOR 
SPANISH-SPEAKING STUDENTS 

•Discuss what kind of job is best for you. 
•Learn how to take employment tests. 
•Learn how to speak in a job interview. 
•Lea;n about deductions from a job paycheck. 
•Discuss job benefits: vacation time. 
•Discuss job benefits: sick leave. 
•Discuss job benefits: medical insurance. 
•Discuss job benefits: social security. 
•Discuss job benefits: pensions. 
•Discuss job benefits: unemployment insurance. 
•Learn about job qualifications. 
•Discuss job benefits: labor unions. 
•Discuss job problems: lay offs. 

•Learn how to read advertisements to tell legitimate offers from suspicious offer 

•Discuss how to look for a job. 

•Discuss how to apply for a job. 

•Discuss job benefits: life insurance. 

•The good and bad of charge accounts. 

•Discuss warranties and how to use them. 

•Fill out application forms. 

•Reading leases. 

•Learn how to get a loan for a car. 
•Learn how to use a bank. 



TABLE 2 

NEW JERSEY ESL FREE RESPONSE ITEMS 



English 

English 
conversation 

comprehension of T.V., movies 

reading and writing 

letters 

composition 

telephone 

English for daily use 

Culture 

customs 
way of life 
ambiance 
everything 
many things 
people 
pace of life 
youth 

people's character 

freedom 

behavior 

American mentality 
social system 
human relations 
family life 
fear 

lack of communication among 

neighbors 
holidays 
racism 
authority 

respect for humanity 
no servants 

social relations of children 

Climate 
climate 

Emplo\;ment 
work 

day of work 

employment opportunities 
start a business 
become a secretary 
become a commercial artist 
become a teller 
become a nurse 
become a factory worker 
join the army 



Emp/oyment (continued) 

learn a trade 
looking for work 
reading newspaper ads for jobs 
job benefits 
social security 
choosing a career 
knowing about employment 
possibilities 
applying for a job 
filling out job applications 
work hours 
labor laws 

Transportation 

finding my way 

getting from place to place 

following directions 

public transportation 

local streets 

cars 

talk to mechanic about problems 
with car 
driver's license 

Food 
food 

restaurants 

Shopping 
shopping 

English in food and clothing stores 
knowing quality of product 
shopping for food 
exchanging items 
knowing correct prices 

Finances 



Academic Subjects (continued) 

politics 
art 

religion 

architecture 

international relations 

literature 

music 

problems affecting humanicy 
science 

U.S. Government and Law 
U. S. laws 

getting a resident visa 
citizenship exam 

Miscellaneous 

emergencies 

calling police or firemen 

car accidents 

the city 

big cars 

wide streets 

pollution 

recreation 

insurance 

utilities 

travel agencies 

Children 
adolescents 

psychology of adolescents 
how to deal with adolescents 
school for children 
talking with children's teachers 

System of Education 
system of education 



money 
income tax 
banking 

economic system 
high cost of living 
welfare 
credit 

money order 

Academic Subjects 

current events 
history 



enrolling in college 
financial airi for college 

Housing 
housing 

appearance of housing 
decorating an apartment 

Clothing 

style of clothing 
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USOE Region X Study 

The User Needs Assessment conducted in USOE Region X by the Northwest Reqioral 

^977^ ARF 1 H u I ^'uf ^ '^«^«'°P*"9 curricular materials (Pickens and Sellers, 

1977). ABE students in Idaho, Washington, Oregon, and Alaska were included in the survey 
To design an .nstrument appropriate for ABE students, each APL consumer economics obiec- 
hve was rewritten o a fifth grade or lower reading level. Respondents were asked if they felt it 
each o^thT 20 areas •"^P°'-<ant," or "very important" for materials to be developed in 

Survey sites were selected to represent the proportion of ABE students in each state 
rural/urban location, ethnic group, income level, age, and sex. Each site received 20 surveys' 
ly to be completed by students and 1 by an instructor. Of the 460 surveys distributed re- 
sponses were received for 382. 

The percentages of students ranking an objective as "very important" varied somewhat 
from state to state and for those in different sex. ethnic, age. and income groups. The manner 
of asking students to rank importance may have influenced student responses Students were 
asked how important it is to develop materials dealing with each area. They may actually have 
ranked a statement as "not important" if their program already had materials related to that 
topic . 

As with other studies, the survey statements varied somewhoc rom the original APL state- 
ment. This variation in some cases resulted in a narrower presentation of the competency 
'x^ "u *° ^"'^ Chanqe Money" and "How to Use Math in Handling Money" for 

To be Abe to Count and Convert Coins and Currency, and to Convert Weights and 
Measures Using Measurement Tables and Mathematical Operations"). 

Pennsylvania Assessment Project 

A statewide APL validation survey was conducted in Pennsylvania as part of an ABE 
Assessment Project (Lindsay and Nead. 1977). The primary purpose of the survey was to 
determine how receptive the participants in ABE programs would be to APL instructional 
topics. The 1.580 student and 277 staff respondents were associated with 60 programs in the 
State and represented beginning, intermediate, and advanced levels of ABE instruction. 

Four general behavior statements that illustrated the reading, writing, computation and 
problem solving tasks represented in each APL knowledge area were developed. Students 
were asked: 

•Could they "do tasks like this now?" 

•If an adult education course could teach them "to do this sort of task well," would 
they take such a course? 

Teachers were asked. 

•Did they teach this type of competency specifically? 

•If they did not teach it specifically, did they provide training in the skill involved? 
•How important did they consider this type of competency? 
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Additional information on the rating of competencies was gathered during a followup 
workshop. 

Since the study was intended to determine receptivity to APL topics, the statements to 
which respondents reacted were composites of selected tasks. For example, the consumer 
economics reading item was stated as follows: 

Being able to read catalogs, consumer guides, advertisements, and similar material, 
in order to select goods and services that you need daily. 

The presentation of life-skills topics also emphasized individual basic skills rather than the in- 
tegration of basic skills to perform an adult life task. Thus, respondents did not react directly to 
statements correlated to an APL objective or task. 

The researchers also collected test data using the original Texas version of the APL 
survey. Because that version of the survey required more time to administer, four parallel tests 
of equal difficulty were compiled. Using a simultaneous person-item sampling technique, the 
tests were administered to students at three instructional levels. 

When categorized according to students' instructional levels and teachers* and workshop 
participants' rankings, the responses to the survey varied. There was, however, general agree- 
ment that occupational knowledge was of greatest importance, with consumer economics 
next. 

Scores on the APL survey indicated that over half of the students fell into the lowest APL 
category (APL 1), and that the APL survey scores were related to instructional placement in 
program. Moreover, the perceived ability to do the tasks included on the questionnaire and 
willingness to take part in instruction related to those tasks was a direct reflection of instruc- 
tional level. That is, more students at the first to fourth grade level fell into the APL 1 range; 
they felt they could not complete the tasks, and were willing to participatf; in instruction to 
learn how. Interestingly though, there appeared to be little relationship between student self- 
assessment of ability and actual performance on related test items. 

In spite of the positive response to desire for instruction for reading, writing, computing, 
and problem solving using life-related materials, counselors, supervisors, and students all 
ranked "Preparing for the High School Equivalency Exam" and "Increased Self-Ccpfidence'* 
as higher priorities than coping with life roles and problems. 

Alaska Validation Survey 

The Alaska APL Validation Survey (Alaska Center for Staff Development, 1978; Alaska 
Commission on Post Secondary Eduction, 1977) was intended to determine the degree of 
congruence between areas in which adults were found to be deficient on the national level and 
the perception among Alaskans in Basic Education Programs as to the relevance of these 
areas. In addition to ascertaining the perceived needs of students across the State, the instru- 
ment was designed to assist local programs in identifying specific needs/interests of students 
within those programs. 
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To compile the survey, the list of 65 APL objectives was used as a basis for 81 items 
across all five APL knowledge areas. Each item began with the words: "I want to learn...." 
Students checked: "Yes," "I think so/' '1 don't know," "I don't think so," or "No." A priority 
rating of 1 to 5 was obtained and mean preference scores were calculated. 

The survey was administered to 392 ABE students and nonstudents between January 
and May 1978. The nonstudents included teachers, administrators, or other professionals 
employed in ABE programs. Data were analyzed according to the following categories: rural 
students, urban students, nonstudents, region, employment status, and income. The priority 
ratings listed in the Summary of Competencies (section 6 of this paper) were those for all 
students surveyed. 

A review of items indicated that several were phrased to be more specific to Alaska (e.g.. 
"How to Store Food, Li!;e Canning or Freezing"). Most, however, were statements that 
reflected portions of APL objectives. In fact, a few could have related to several objectives 
(e.g., "1 Want to Learn About Buying Food"). The priority rankings of items and APL 
categories varied noticeably among people included in the categories above. Often, one item 
would fall among the top 10 for one group, but not be similarly ranked for any other group. 
Preference for general APL knowledge areas, ranked across all groups, was as follows: (Dcon- 
sumer economics; (2) health; (3) government and law; (4) community resources; (5) occupa- 
tional knowledge. 



4. Competency Identification Studies Not 
Limited to APL 

Utah Consumer Competencies Study 

A somewhat unique approach was used by the Consumer Research Center to identify 
specific consumer competencies needed by Utahans (Alfaro and Gillpatrick, 1978). Beginning 
with the proposition that Utah's cultural and economic situations are unique, the researchers 
also recognized the effect that life-cycle position might have on consumer competency needs. 

To prepare a preliminary list of consumer needs, the researchers used information from: 
(1) a literature review, through which consumer education topics were identified; (2) an ex- 
penditure profile, based on Bureau of Labor Statistics data, of adult consumers according to 
life-style stages; (3) a list of prominent consumer frauds in Utah; and (4) a subjective 
knowledge of the demographic and cultural make-up of the State. 

The list of consumer needs was then ranked according to the following criteria: indicated 
economic importance to Utahans; incidence of consumer fraud complaints; and judged poten- 
tial for improving the well-being of Utah consumers through education. The list was also rank- 
ed for people in the following circumstances: bachelor state; young married; full nest I; full nest 
II; full nest III; empty nest I; empty nest II; single parent with children. Competency topic areas 
included housing, transportation, home management, and finances. 

The priority of topics and the specific tasks associated with each varied according to the 
life stage. For example, the top priority for young marrieds was transportation; for empty nest 
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II, it was health. Although financial planning was third in priority for both groups, young mar- 
rieds emphasized budgeting, credit-banking, and financial records, while Social Security, wills, 
trusts, and estates were more important for empty nest 11 adults. The list of consumer needs 
identified through these rankings provided the basis for developing specific behavioral objec- 
tives— i.e., the values, knowledge, and skills deemed necessary to make an economically ra- 
tional expenditure. 

The Utah listing included items from the APL areas of community resources, occupational 
knowledge, and health. In addition, many of the specific competencies could be considered to 
be above the level of minimal coping (e.g., wills and estate planning, music lessons/ 
instruments). 

To aid in the development of curriculum, project staff recommended that instruction be 
modularized. Core topics would provide a common instructional experience. Modules would 
augment the core instruction and deal with the immediate competencies associated with each 
core topic for the various life situations. This system was intended to provide flexibility and ap- 
propriate instruction for adults. 

The use of Bureau of Labor Statistics data to develop spending habit profiles for eight life- 
style stages suggests a relevant consideration for competency identification studies. Although 
only national statistics were available, the findings were modified to suit Utah's demographic 
and cultural situation. The lack of available objective data specific to Utah required substantial 
reliance on subjective judgment for this modification. It should be noted that this research 
design did not include collecting questionnaire or assessment data from Utahans. 

The Utah study represented a different approach to identifying competencies— one that 
attempts to deal with the reality of adult life and adult learning. Invariably, needs assessments 
have found that the interest and perceived needs of students vary according to sex, age, ethnic 
group, income, and other factors. In addition, a prevalent observation among adult educators 
is that instruction must appear relevant to individual learners. The concept of identifying varia- 
tions in emphasis of particular competency topics for groups and individuals is important for 
program developers in that it allows for variation in competencies acquired and tasks under- 
taken while maintaining some consistency in curriculum competencies. 

Adkins-Connecticut Reconnaissance Survey Method 

As the first step in designing a Life-Skills Educational Program, Winthrop Adkins pro- 
posed an approach for identifying specific social and psychological problems of living (Adkins, 
1977). The procedure, called the Reconnaissance Survey Method, stresses the collection of 
qualitative data through counseling-interview techniques. The information collected is then 
analyzed to identify clusters of problems and to organize specific problem data within each 
cluster. Collection and refinement of problem statements are carried out over a series of inter- 
views with several groups. Generally, the approach is similar to grounded theory or qualitative 
research procedures. 

The Reconnaissance Survey procedure was used in the Valley Regional ABE program 
area of Connecticut. This program served five towns in the State and was considered to be 
representative of the State s industrial regions. Interviews were conducted with 258 people 
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the fact that, although individuals can increase their competencies by acquiring information 
and skills, there is also an external, societal factor involved in success. This factor places an 
added burden on disadvantaged adults and may, in fact, produce barriers that cannot be over- 
come through education. 

California ABE Needs Analysis 

The California Division of Adult and Continuing Education contracted with NOMOS In- 
stitute (June 30, 1977; December 1977) to conduct a Statewide analysis of public needs for 
Adult Basic Education. The intent was to identify all necessary competencies that are func- 
tional to economic and educational success in today's demanding, complex society. The pro- 
posed procedures for identifying these competencies involved, first, a systematic search of ex- 
isting information from which a universal list of competencies could be developed. The APL 
list was one source; the researchers also used such other sources as public agencies, a literature 
search, statistical data from public records, and interviews with educators, legislators, agency 
staffs, and others. The final selection of a set of competencies was then determined by an ap- 
pointed panel of adult educators. 

NOMOS was also to determine the standards for the competencies, methods for deter- 
mining possession of competency, a sampling plan, and the competency levels of California 
adults. Although the researchers drew on the APL listing, information from interviews with 50 
agency representatives indicated that previous work had not accurately identified many of the 
competencies. The plan was interesting for its proposed use of multiple sources to identify 
competencies and the variety of "found'' data, such as tax returns, that were to be used to 
determine performance indicators and criteria. 

The project report indicates that the list of specific competencies evolved from: a literature 
review; a listing of generalized competencies; the composition of an organizational framework; 
specific statements generated by an expert panel; and extensive review, rewriting, and editing 
(NOMOS, May 1978). The proposed procedures are worth considering because they repre- 
sent a theoretical perspective regarding procedures that should be followed. That such pro- 
cedures were not implemented as planned demonstrated the practical realities of doing 
research to identify competencies, especially when available time is limited. 

Five major competency categories were determined: 

•Cultural Competenc/es— related to beliefs, attitudes, traditions, and behaviors 
strongly held by society and including such things as art expression and apprecia- 
tion; custom, ceremonies, and traditions; communication, recreation, and leisure; 
religion, morality, and values; and philosophy, science, and history. 

•Economic Competencies — related to acquiring and managing goods and services 
and including such activities as banking, budgeting, consumerism, and employ- 
ment. 

•Health and Safety Compefenc/es— including such areas as first aid, health hazards, 
nutrition, and health literacy. 

•Interpersonal Compefenc/es— including such competencies as verbal communica- 
tions, self-awareness, and handling stress that enable a person to live with and 
among others. 
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•Socio-political Competendes— including citizenship, sources of information, legal 
processes, political processes, public resources, and transportation. 

The five categories contained subcategories and specific statements for each subcategory. 
These specific statements represented the competencies. 

The resultant list contained some competencies that many might not consider necessary 
for successful survival (e.g., "Recognize Major Forms of Dance" and "Engage in Creative Pur- 
suits"). The criterion for necessity is one that must be very clearly stated and that deserves 
greater attention by those conducting competency identification studies. 

In discussing definitions of competency. Heath (1978) addressed these conceptual con- 
siderations. He asserts that: "A competency at a particular level of performance is functional 
when it serves to meet a need of a person with particular characteristics. . .in a particular set of 
circumstances." Functional competency is viewed as a means toward individual liberation 
through enabling a person to meet a self-perceived need. Heath further points out that 
although a person may not have a particular competency, as indicated by performance on 
some test, this does not establish that the individual needs to develop that competency. Fur- 
ther, to identify the need for educational treatment, the client must be aware of the compe- 
tency deficit, must come to perceive the deficit as undesirable, and must think it possible to 
move toward reducing that deficit. 

A Statewide survey of adult competency in California utilizing the 130 performance in- 
dicators developed by NOMOS was recently conducted. The respondent sampling was based 
on selected geographic region, ethnicity, age, and gender stratification variables. In addition, 
certain census variables were used to describe the sample, including employment status, oc- 
cupational level, highest grade of school attended, marital status, place of parent's birth, and 
language spoken at home when the adult was a child. The criteria for analyzing the responses 
or performance levels for each survey question were thought of as: Level One = a correct 
response; Level Two = an incorrect response; and Level Three = a nonscorable response. 

On the^ 130 performance indicators used, the total sample achieved a 75 percent overall 
"competent" (Level One) performance level. Women performed slightly better than men on 
these indicators, and this difference was consistent in magnitude across all other categories ex- 
cept the economic category, in which men and women performed at nearly identical levels. 
The age group between 30 and 60 years, on the average, displayed higher competency scores 
than both the groups between 15 and 30. years and those over 60 years. Ethnic minorities 
scored consistently lower than the white majority. Comparing pe^-formance in 10 of the State 
statistical areas showed that the urban centers have heavy concentrations of populations with 
competency performance deficits. 

When the sample was categorized by employment status, those not working evidenced a 
performance level considerably lower than those employed either parttime or fulltime. Simi- 
larly, those who had completed more formal education scored better on the survey. 

Among the marital status groups, those who were widowed appear to have the largest 
performance deficits. Adults whose parents were born outside the United States and those 
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raised in homes where language other than English was spoken also scored poorly on the per- 
formance indicators. 



In summary, the major demographic groups with the most severe performance deficits 
were (rank order not implied): young adults and the elderly; minorities; urban residents; those 
not employed; those with little formal education; the widowed; immigrants and those with im- 
migrant parents; and those with non-English language home backgrounds. 

The analysis of survey data also focused on the five categories of competencies: 
•Cultural Competencies. Performance on these indicators seemed particularly re- 
lated to minority status and formal education. Linguistic minorities seemed to have 
particular difficulties in finding adequate recreational resources. 

•Economic Competencies. Performance levels were lowest among the young (under 
20), the elderly, the unemployed, and those with non-English speaking home 
backgrounds. 

•Health and Safety} Competencies. This category included performance levels that 
were higher than any of the other categories (nearly 80 percent correct). Adults 
whose parents were not born in the United States and those who grew up in homes 
in which a language other than English was spoken had somewhat lower scores 
than the average of the total sample. In general, the three most difficult topics were 
first aid, birth control methods, and fire emergencies. 

•Interpersonal Competencies. In general, this category was more difficult for men, 
those with little education, the elderly, and those whose parents were not born in 
the United States. 

•Socio-political Competencies. Ethnic minorities, those at low occupational levels, 
and those with non-English speaking home backgrounds had the largest per- 
formance deficits. 

New York External High School Diploma Program Competencies 

The External High School Diploma Program for Adults in New York State bases the 
award of a diploma on demonstration of generalized and individualized competencies. It is not 
an instructional program, but concentrates on the identification and assessment of competen- 
cies. The generalized competencies are those considered to be prerequisite to further learning. 

When the program was being developed, studies identifying competencies (e.g., the APL 
study) were not available. As a starting point, the project design group identified seven 
general areas: Communication, Computation, Self-Awareness, Social Awareness, Consumer 
Awareness, Scientific Awareness, and Occupational Preparedness (Bailey et al., 1973). Com- 
petencies in each of these areas were identified with the assistance of a task force of 14 persons 
having a knowledge of secondary school curricula, prior professional experience with adult 
learners, broad life experience, and ability and prior experience in writing behavioral objec- 
tives. 

The program developers, working in small groups, identified and agreed on 64 com- 
petencies in response to the question, "What skills do adults need to cope with daily living?" 
Representatives from small business, industry, unions, schools, and social agencies reacted to 
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the list, which was then refined, and the regional committee for the diploma program reviewed 
and critiqued the list prior to the final approval (Nickse, 1977). 

Two assumptions guided the task force: 

•That the application of learning is holistic; skills such as reading and math were 
therefore to be demonstrated in context. 

•That competencies and the performances by which they are tested must be related 
to the common developmental tasks of adulthood. 

Program staff clearly recognized that the choices of competencies and the selection of skills to 
be assessed involved value judgments and were somewhat arbitrary. Nevertheless.^, the similar- 
ity between the content of the New York list and that of other listings is remarkable. 

The list of generalized life skills minimum competencies, however, should be considered 
within the context of the entire program design, which assesses the possession of the com- 
petencies through five tasks: (1) a series of exercises related to community awareness; (2) an 
interview concerning personal and family health; (3) a series of exercises related to occupa- 
tional preparedness; (4) an interview in which personal and social awareness issues are ad- 
dressed; and (5) the application of problem solving skills to consumer purchases. Once can- 
didates have satisfied the generalized competency requirement they must also demonstrate 
competency in occupational/vocational and advanced academic or specialized skills (music, 
art, community service) to qualify for the diploma. 

The process of identifying and assessing competencies in each area involves many in- 
dividuals in the community. For example, in the occupaticr.dl and vocational area, experts 
from the community identify the competencies to be demonstrated. The process includes iden- 
tification of the candidate's job skills; a review of the Dictionor]^ of Occupotionol Titles specific 
job skills by the program assessor; identification of the community "expert"; establishment of 
standards and competencies by the expert; administration of the performance assessment by 
the expert in conjunction with the assessor; and review by all experts of competencies iden- 
tified and performance levels expected. The process Ihus emphasizes the identification of job 
skills competencies that include local standards for performance. To date, over 90 checklists of 
competencies have been developed through this procedure. 

Since the selection of area and particular competencies within each area are individual- 
ized, the cross-reference competency summary in St>ction 6 of this paper considers only those 
included in the generalized life skills areas. The stress on the five tasks listed above has also 
been taken into account. 

National Center for Research in Vocational Education Project 

The Occupational Adaptability Research Program at Ohio State University's National 
Center for Research in Vocational Education (NCRVE) has recently completed an investiga- 
tion of competencies and literacy needs for occupational adaptability and transferable skills 
(Selz, 1980). The concept of transferability presented considers the basic academic skills as 
underlying components of functional competency and stresses the ability to transfer skills and 
knowledge previously learned to a new situation. OccuDational success— not just securing but 
keeping a job, changing and advancing, and feeling satisfaction— was seen as contingent on 
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possessing the ability to transfer. Within this framework, the project staff sought to collect infor- 
mation that would be useful to practitioners and legislators concerned with competency-based 
education or minimal competency testing. 

A master list of functional competencies related to occupational adaptability was compiled 
from those included in other major research and testing efforts. These tasks were ranked ac- 
cording to priority by experts in adult competency-based education and personnel represen- 
tatives from business. Competencies were defined in terms of specific basic skills. A survey 
consisting of 39 statements phrased in everyday language was then developed and field tested 
to eliminate ambiguity. 

People surveyed responded to the following questions: 

•Where should a person be taught this (home, school, or on the job)? 

•Where do most people actually learn this (home, school, or on the job)? 

•If a person did not have this ability, how well would he/she do at work (do well, 
have some difficulty, or have a great deal of difficulty)? 

It is this last question that was designed to determine the importance of the competency. 

Four groups were surveyed: the general adult population, high school students, teachers, 
and employers. A representative sample of 2.083 English-speaking adults 18 years and older 
were interviewed on a door-to-door basis. To obtain responses from teachers and high school 
students. 106 public school systems in the contiguous United States were systematically 
selected and asked to participate; 37 agreed. Although the design called for a sample of 1.500 
teachers, only 978 responded. A total of 1.566 high school seniors, selected from the same 
school systems as the teachers, also responded to the survey. Employers were selected to rep- 
resent type of industry, size of company, and geographic region. Of the 200 surveys mailed, 
107 were returned. 

Opinions regarding where skills should be taught did not vary greatly among the four 
response groups There was also high agreement between where an ability should be taught 
and where it was actually learned. However, many competencies thought to be the respon- 
sibility of the school were actually learned at home or on the job. With respect to judging the 
importance of an ability, the responses were consistent across the groups. Respondents 
thought people would have some problems if they did not have the abilities listed. On the basis 
of mean responses of the general adult population, the competencies were ranked by impor- 
tance for doing well at work. The 10 most important competencies, in rank order, were: 

•Use reading, writing, and math skills called for by a job. 

•Use tools and equipment called for by a job. 

•Deal with pressures to get the job done. 

•Get along with others. 

•Follow rules and policies. 

•Do parts of the job that one may not want to do. 
•Have a good work attitude. 
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•Follow job safety and health rules. 

•Hold a job that matches one*s interests and abilities. 

•Get a job for which one has the training and background. 

Though the correlation across groups in the ranking of important abilities war high, the em- 
ployer group was more emphatic than the other groups on the need for many of the abilities. 

For the purposes of the Summary of Competencies, the general population response rate 
is listed. It must be noted, though, that since no competency was perceived as unimportant, all 
39 could be considered relevant and important to developing occupational competency. 

A second survey was conducted to determine the consumer economics competencies 
needed to get along in life. Similar procedures were used to arrive at a 40-item consumer 
economics survey. Again, respondents were asked: **Where should you be taught this ability?" 
and "Where did you actually learn this ability?" Importance was assessed by asking: **If you did 
not know how to do this, how well would you get along in life?" Response options were: "Get 
along very well," "Have some problems," and "Have a great deal of difficulty." A separate na- 
tional probability sample of 2,054 persons was selected using a procedure similar to that used 
for the occupational adaptability general population survey. (For the Summary of Competen- 
cies, the percentage that indicated "great difficulty" in response to the question of importance 
was recorded.) The 10 competencies deemed most important, in rank order, were: 

•Make change using bills and coins. 

•Manage money so that you can pay your bills. 

•Balance a checkbook. 

•Write a check or fill out a money order. 

•Keep records and receipts to file income tax forms. 

•Add the total (plus tax) of a purchase. 

• Prepare and stick to a budget. 

•Be able to tell when you are not getting satisfactory service (like from doctors, 
lawyers, mechanics, etc.) 

•Take good care of your belongings and property. 

•Decide which purchases you make are necessary and which are not. 

As with the survey of occupational adaptability competencies, the NCRVE project staff 
will continue to analyze these data, particularly for differences in importance that may reflect a 
different sense of priorities and needs of various socioeconomic and ethnic/racial groups. 

Northwest Regional Educational Laboratory 
Functional Literacy Project 

Recognizing that people's mastery of and need for reading, writing, and other skills vary 
tremendously according to their societal circumstances and personal situations, the Functional 
Literacy Project at Northwest Regional Educational Laboratory (NWREL) designed a pro- 
cedure to identify the specific literacy needs of a community. The process is now being field 
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tested in one site. A three-phase procedure has been outlined for this study (Reder, 1978): 

•Phase /—Identification of the ways in which literacy skills are patterned into people's 
daily lives. This identification will entail gathering such information as: "What do 
people in the community read in the course of their everyday activities?" and *'What 
materials are used?" The researchers will also attempt to identify where and how 
literacy is acquired and how literacy affects oral and written communication. The in- 
formation gathered will be used to ascertain the different life domains (e.g., work, 
social life) in which literacy skills are used and the value placed on those skills. 

•Phase //—Select one or more life domains for intensive investigation. Community 
interest and the opportunity to conduct research will be considered in the selection 
of the domain(s), and the procedures used in Phase I will then be applied more in« 
tensively to the domain (s) selected. 

•Phase ///—Design and delivery of literacy instruction. The instructional component 
will also enable project staff to collect longitudinal data regarding adult literacy 
development. 

Implicit in the above process is an awareness of literacy as a contextual tool. Use of written 
materials is seen as part of a broader activity, and is affected by the materials pertinent to this 
activity and other components of a total situation. While a lengthy and involved procedure, it is 
one that shows great potential for identifying more accurately the competencies necessary for 
successful funct ^ning in a specific location and for a specific purpose. 



5. Summary of Purposes and Procedures 

The studies presented in this paper vary in their purposes, procedures used, and manner 
of stating the competencies and of asking questions on a survey. This is inevitable considering 
the many judgments that the study directors and sponsors had to make. This variability makes 
cross-referencing difficult and, at times, quite subjective. 

As a prelude to the comparison of competency objectives presented in section 6, the 
variations in purpose and method are presented first. These should assist the reader in inter- 
preting the various findings and using the summary charts. Collectively, these studies had 
several purposes: 

•To identify necessary competencies for adults nationally, regionally, within a state, 
or within a portion of a state. 

•To determine the learning needs of adults. 

•To gather data for curriculum decisions. 

•To ascertain the applicability of or receptivity to competencies specified by the APL 
study. 

•To provide a model for program personnel to determine the needs of their students. 
•To expand upon the APL list. 

Several studies included multiple purposes. Table 3 summarizes the purposes for conducting 
each of the studies. 
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PURPOSES OF STUDIES 
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regionally 




X 






















statewide 






X 




X 


X 


X 




X 


X 






portion of 
a state 








X 








X 




X 




X 


To determine 
the learning 
needs of 
adults 
(interest) 






X 


X 


X 






X 




X 






To make 

curriculum 

decisions 


X 


X 


X 






X 


X 










X 


To ascertain 
the applicability 
or receptivity 
to APL 




X 


X 




X 
















To provide a 
model for 
local needs 
assessment 
for programs 












X 








X 




X 


To expand 
APL list 








X 












X 


X 





A list of possible procedures for identifying competencies and an indication of procedures 
used in each study are summarized in table 4. These procedures include: 

•Collecting prior literature and data from a variety of sources. (An X next to ''Col- 
lecting prior literature and data*' indicates information other than APL.) 

•Collecting additional information: 

—Questioning adults regarding what they need to know or are interested in learning 
(qualitative) . 

—Asking experts or providers of services to adults to identify what adults generally 
or clients of a service need to be able to do. 

—Asking people to respond to a list of pre-specified competencies and to indicate 
necessity or interest (quantitative; questionnaires/surveys). 
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TABLE 4 



SUMMARY OF PROCEDURES USED TO IDENTIFY COMPETENCIES NEEDS 



Study 
Procedure ^"^^ 


APL-Based Studies 


Studies Not Limited to APL 


APL 


NWREL. USOE 
Region X 


N.J. 
ABE 


N.J. 
ESL 


Penn. 
ABE 


ALASKA 


UTAH 


ADKINS- 
CONN. 


NEW 
YORK 


CALIF. 


NCRVE 


NWREL 
Functional 
Literacy 


Collecting 
prior literature 
sind data from a 
variety of 
sources 


X 












X 




X 


X 


X 




Collecting 
additional in- 
formation : 


























a) Questioning 
adults regarding 
what they need to 
know or are inter- 
ested in learning 
(qualitative) 








X 








X 










b) Asking ex- 
perts or pro- 
viders of 
services to 
adults to identi' 
fy what adults 
generally or 
clients of a 
^ervice need to 
be able to do 


X 

















X 


X 


X 
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TABLE 4 (continued) 



Study 

Procedure 


APL-Based Studies 


Studies Not Limited to APL 


APL 


NWREL, USOE 
Region X 


N.J. 
ABE 


N.J. 
ESL 


Penn. 
ABE 


ALASKA 


UTAH 


ADKINS- 
CONN. 


NEW 
YORK 


CALIF. 


NCRVE 


NWREL 
Functional 
Literacy 


c) Asking people to 
respond to a list 
of pre-specified 
competencies and 
to indicate 
necessity or 
interest 
(quantitative; 
questionnaires/ 
surveys) 




X 


X 


X 


X 


X 








X 


X 




d) Analyzing what 
people do in 
relationship to 
performing 
certain roles 
or activities 


















X 






X 


e) Selecting models 
of people 
"functioning 
successfully" 
and analyzing 
behaviors and 
qualities that 
arc related to 
success 



























3^ 
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TABLE 4 (continued) 



N. Study 
rracdure \ 




APL-Based Studies 




Studies Not Limited to APL 




APL 


NWREL. USOE 
Region X 


N.J. 
ABE 


N.J. 
ESL 


Penn. 
ABE 


ALASKA 


UTAH 

W 1 1 II 1 


ADKINS- 
CONN. 


NEW 
YORK 


CALIF. 


NCRVE 


NWREL 

FnnrtionAl 

1 UllLUUllGI 

Literacy 


Administering 
tasks to a 
sample of adults 


























a) Multiple- 
choice, open- 
ended items 


X 




X 




X 










X 






b) Performance- 
based tasks 




























—Analyzing what people do in relationship to performing certain roles or activities. 

—Selecting models of people ^^functioning successfully" and analyzing behaviors 
and qualities that are related to success. 

•Administering tasks to a sample of adults: 

— Multiple-choice, open-ended items. 

—Performance-based tasks. 

The procedures marked for each study are those specified in the reports. Although the New 
York State program model uses performance-based assessment to award diplomas, that pro- 
cedure was not used to determine minimal competencies to be required in the program. Thus, 
two methods for determining minimal competencies— analyzing the behavior and qualities of 
persons functioning successfully, and administering performance tasks to a sample of adults- 
were not employed by any of these efforts. 

Because they were done prior to the publication of the APL study, neither the Adkins- 
Connecticut study nor the New York State listing of minimal competencies was influenced by 
the APL findings. Additional data sources for these efforts and the Utah study included: 
(1) Bureau of Labor Statistics data and expenditure pattern data; (2) consumer and social serv- 
ice agencies; (3) studies regarding adult development; (4) other sociological writings; (5) 
general literature regarding competency. 

6. Summary of Competencies 

To compile the cross-reference Summary of Competencies from the studies reviewed, the 
65 APL objectives were used as the base list. The use of the APL category labels and objectives 
does not imply a preference for the organization and use of terms presented in APL. Rather, 
the choice seemed reasonable as a purely practical decision since many of the studies were 
designed with direct reference to APL. 

To prepare the cross-reference list, each APL major objective ana the enabling objectives 
associated with it were listed. For each study (with the exception of the NWREL Functional 
Literacy Project, which has not yet produced a set of competency statements) , the competen- 
cies included were cross-referenced against the APL enabling objectives. Cross-referencing at 
this level of detail revealed variations in emphasis and inclusiveness. 

Decisions regarding congruence of the competency statements required substantial 
judgment. Variations in phrasing and organization of competency statements across studies 
frequently made it difficult to judge the original researcher's intent and the extent of similarity 
with APL statements. Such decisions were somewhat clearer with the APL validation studies, 
so long as the basic comparison was with the major objective. Even for these studies, however, 
there were inconsistencies in scope and procedures. For example, the number of items used to 
determine necessity of APL consumer economic competencies ranged from 8 in Pennsylvania 
to 43 in the New Jersey ESL study. In some cases, researchers used several statements that 
paralleled enabling objectives under a competency; in other cases, one statement roughly 
paralleled several APL enabling objectives under a competency. Sometimes, no statements 
were included for a particular APL objective. The authors of these reports were asked to 
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review these judgments, and either agreed or made suggestions for change. Most of their 
recommendations were readily accepted. 

The variations in items from the statement of APL objectives may have resulted from 
several considerations: (1) desired length of the overall survey; (2) comprehensiveness or 
simplicity of the original APL statements; and (3) researchers' own judgments regarding im- 
portance. The final statements often represented a trade-off between creating succinct, read- 
able Items and conveying a competency rather than a task. The less specific the item, the more 
the respondent could read into it. The exact behaviors respondents associate with a compe- 
tency statement may also vary, demonstrating the difficulty of obtaining reliable responses to 
the competencies intended when preparing instruments. 

Considering the variations across the studies, it seemed appropriate to list the main intent 
of the original APL competency, especially since the more recent APL listing contains objec- 
tive statements that are phrased somewhat differently than the original list of 65 objectives. 
Therefore, the objectives listed in the Summary of Competencies are topical -roughly parallel 
to the APL major objectivts— rather than a series of competency statements. 

The Summary of Competencies is in four parts: 
•Part 1— Knowledge/Information Categories. 
•Part 2— Basic Skills. 

•Part 3— Major Objectives by Competency Area. 

•Part 4— Additional Objectives (i.e., not emphasized in APL, but included in other 
studies) . 

Most of the studies covered all five of the APL knowledge categories. Consumer 
economics and occupational knowledge, however, seemed to be emphasized more. The Utah 
effort considered only consumer economics, but on closer examination, many of its statements 
related to APL objectives in the community resources, health, and occupational knowledge 
areas. Community resources, an area often ranked as low in importance by ABE students and 
staff, received a greater emphasis in two listings (Adkins-Connecticut and New York). The low 
perceptions of importance for community resources, however, were often a response to the 
specific APL objectives. Use of community resources was included in the other four knowledge 
areas as part of many other competencies (e.g., "using community resources to deal with 
fradulent practices" might be included in a consumer economics section). Cultural and self- 
awareness was an additional knowledge category not emphasized in the APL presentation but 
used in several studies. 

The summary of basic skills also required a great deal of the writer's judgment in consider- 
ing the direct statements in the reports, knowledge of the studies, and inferences drawn from 
the competency statements. The findings, when considered in conjunction with practice and 
practitioner comments, underscored the perceived importance of reading, writing, and math 
skills and of preparation for passing the GED test for high school equivalency. While problem- 
solving and interpersonal relations skills were included in the APL matrix, the perceived impor- 
tance of these abilities varied. At least two-Adkins and New York-appeared lo emphasize 
these skills more heavily than did the APL-related efforts. 
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Parts 1, 2, and 3 of the Summary of Competencies used the APL listing of 65 objectives 
as the basis of comparison, although some modifications and a few additions were introduced. 
The summary indicates the degree of correspondence between the individual studies and the 
APL baseline list. 

In four of the studies— NWREL USOE Region X, New Jersey ABE, New Jersey ESL, 
and NCRVE— the respondents indicated whether they thought the competency was 
necessary, important, or helpful in accomplishing tasks of adult life. The summary reports the 
percentage who felt this was so. In the Alaska project, the 81 statements were ranked in order 
of priority. The summary lists the ranking for each. 

Part 4 of the summary lists competencies that were added by the studies not limited to the 
APL. In these cases, no judgments as to degree of relatedness were made. 

While the Summary of Competencies indicated correspondence among the various topics 
considered, it did not totally convey the variations in emphasis. For example, the APL listing 
incorporated a strong emphasis on basic skills in all objectives. The Adkins list was comprised 
of a series of problem, not competency, statements. Many of the validation studies— the New 
Jersey ones and Alaska, for instance— were comprised of a list of general statements that may 
have corresponded to a major goal or to several of the substeps under that goal. 

It must also be remembered that several of the studies were limited to only certain 
knowledge areas (e.g., consumer economics). Decisions regarding which components to in- 
clude and how to phrase the statements determined what choices the respondents could make 
about the importance of a competency. The inclusion of a topic or skill on a survey 
represented the researcher's and sponsor's judgment about what was important. Thus, these 
judgments about what would and would not be included Ipi the survey, as well as the presenta- 
tion of the items and questions, established the limits for the responses. 

This Summary of Competencies is not intended to be a definitive listing. It is useful in 
pointing out those areas that a number of large-scale studies have determined as important or 
necessary for functioning in adult life. There appears to be a fair amount of consistency across 
the 11 projects included, as well as a number of areas in which one or more of them have put 
greater or lesser emphasis. The topics listed by those studies not limited to APL indicate other 
areas to be considered. 

The purpose of the summary and this report is to assist Adult Basic Education program 
administrators and instructors in selecting those areas that would be appropriate for their pro- 
grams. Variations according to region, state, locality, population group, and individual student 
needs are likely to continue to exist. Those who are considering program changes consistent 
with new emphasis in the Adult Basic Education Act are urged to look at the results of these 
studies as a starting point. Substantial time and effort could be saved by adapting these com- 
petencies to individual program and student needs rather than beginning the process all over 
again. 
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Study 



Category 



Consumer Economics 



Community Resources 
Problems in living in 
community 



Government and Law 
Citizenship 



Health and Safety 
Maniage and family 
problems 

Problems of being a parent 



Occupational Knowledge 



Cultural 
Self-awareness 
Social awareness 
Problems in personal growth 
and development 



SUMMARY OF COMPETENCIES, PART 1: 
KNOWLEDGE/INFORMATION CATEGORIES 



APL 



65 

obj 



41 
obj 



APL-Based Studies 



NWREL. USOE 
Region X 



N.J. 
ABE 



37% 
h60% 



24% 
h48% 



t 

38% 
h71% 



N.J. 
ESL 



Penn. 
ABE 



28% 
h52% 



40% 
h71% 



Alaska 



Studies Not Limited to APL 



Utah 



9 



3 



0 



Adkins 
Conn. 



(!) 



® 



N.Y, 



® 



Calif. 



3 



NCRVE 



Key to Symbols. . = sen ally the same as APL 3 = .niphasis on a sub-category of API 

R«nonHpn.- n ® ' r ' ''''' "'^^ ^'"'''^ ' - "^^^ginal relationship to APL 

Respondents Opinions: h = percent reporting objective would be helpful; p = priority ranking of 

the objective out of total of 81; all other percents are of those reporting 
objective is important or necessary, - , , , 

o 0 ( 

ERIC 



SUMMARY OF COMPETENCIES, PART 2: 
BASIC SKILLS 





APL-Based Studies 


Studies Not Limited to APL 


X. oiUQy 


APL 


NWREL, USOE 
Region X 


N.J. 
ABE 


N.J. 
ESL 


Penn. 
ABE 






Adkins- 
Conn. 








Skills \. 

\ 


65 
obj. 


41 

obj. 




Utah 


N V 


V^dlll, 


NPRVF 


Communications Skills 


• 


• 


• 


• 


• 




0 


0 


3 


ft 


3 


0 


Reading 


t 


• 




• 




t 








ft 






Writing 


ft 


• 




* 




ft 








ft 






Listening, speaking, 
viewing 


• 


• 




• 












ft 






Language 










t 
















Computation Skills 


V 


• 


0 


• 


• 


ft 


ft 


0 


0 


ft 


3 


3 


Scientific awareness 














d61 






A 

W 






Interpersonal Relations 


t 


f 




— — 






3 








ft 


ft 


Problem Solving 
(making decisions) 


• 


• 








ft 






® 


® 






Specific Job Skills 








• 










t 






ft 



Key to Symbols: ft = essentially the same as APL; 3 = emphasis on a sub-category of APL; 

® = essentially the same as APL, but with greater emphasis; o = marginal relationship to APL. 
Respondents' Opinions; h = percent reporting objective would be helpful; p = priority ranking of 

the objective out of total of 81; all other pcrcents are of those reporting 

objective is important or necessary, 
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SUMMARY OF COMPETENCIES, PART 3: MAJOR OBJECTIVES BY COMPETENCY AREA 

Consumer Economics 




Counting and converting 
coins and cun-ency, weights, 
and measures 



Understanding income tax 



Managing money (budgeting) 
and consumerism 



Using catalogs 



Using consumer guides, 
making decisions about 
purchases 



• 



Factors that affect costs of 
goods and services 

Under?' iding how 
changt d the economy 
make a difference in how 
much you have to spend 



APL-Based Studies 



NWREL, USOE 
Region X 



t 

61% 



N.J, 
ABE 



3 

15% 
hl5% 



75% 



50% 



64% 



(I 

60% 
hl6% 



3 

48% 
hl9% 



N.J, 
ESL 



d 

65% 
72% 



Penn, 
ABE 



79% 



69% 



Alaska 



p38 
p67 



Pl 



p4 

0 

p39 



p68 



3 

p39 



0 

p48 



Studies Not Limited to APL 



Utah 



Adkins- 
Conn 



<ey to Symbols: • = essentially the same as APL; 

® = essentially the same as APL, but with greater emphasis; ^ - M.a.yma 

Respondents' Opinions: h = percent reporting objective would be helpful; p = priority ranking of 

the objective out of total of 81; all other percents are of those reporting 
objective is important or necessary, Q 

ERIC 



N,Y, 



Calif, 



® 



NCRVE 



0 

67% 



0 

50% 



3 



65% 
37% 
46% 



17% 



3 

28% 



0 

35% 



33% 



3 = emphasis on a sub-category of APL; 
0 = marginal relationship to APL. 



Consumer Economics (continued) 







APL-Based Studies 


Studies Not Limited to APL 


X Study 


APL 


NWREL. USOE 
Region X 


N.J. 
ABE 


N.J, 
ESL 
















Objective X,^^ 


65 
obj, 


41 

obj. 


Penn. 
ABE 


Alaska 


Utah 


Adkins- 

VUl 111 . 


N.Y. 


Calif. 


NCRVE 


Comparison shopping; 
price vs. quality 


• 


(» 


64% 


0 

h29% 


• 

/ On 

68% 
88% 


0 


0 

n /1Q 

pno 


• 


• 


3 


3 


0 

25% 


Packaging of goods; cost- 
effectiveness for quality 
and storage 


• 




3 

35% 




• 

75% 


0 




• 


• 




3 




Sales (understanding and 
making decisions to buy) 


V 




3 


0 

20% 

h 

n 1 / ^ 




0 


• 

p50 




• 


3 


3 


0 

47% 
25% 


Understanding advertising 
techniques 


• 




3 


0 

20% 
hl6% 


• 

84% 


3 


3 

pis 


• 




3 


• 


• 

31% 
3 

37% 
0 

24% 


Ordering food and tipping in 
a restaurant 


• 


• 


• 

16% 


• 

11% 
h 8% 


• 

66% 
70% 
52% 


0 


• 

p75 
p80 


• 






0 




Purchasing home furnishings 


• 


3 


3 

54% 




75% 


d 


0 

p64 


• 

. .i 


• 


® 




0 

37% 
19% 
25% 
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Consumer 



Economia (continued) 







APL-Based Studies 


f Studies Not Limited to APL 


\ Study 


APL 


NWREL, USOE 
Region X 


N,J. 
ABE 


N.J. 
ESL 
















Objective 


65 
obj, 


41 

obj, 


Penn. 
ABE 


Alaska 


Utah 


Adkins- 
Conn, 


N.Y. 


Calif. 


NCRVE 


Obtaining housing, utilities 


m 
w 


• 


• 

73% 

cocr 
00% 


38% 
h20% 

38% 
hl8% 


d 

72% 
64% 
44% 
84% 
69% 
63% 
72% 
76% 




• 

p55 
p60 
p70 


• 


• 


• 


• 


0 

27% 
33% 
31% 


Buying and maintaining a 




f 


64% 




0 




p58 
p47 


• 






• 




Care of personal possessions 
(cleaning, having things fixed, 
warranties) 


f 


• 


• 

53% 


0 

43% 
h26% 


0 

72% 
88% 


d 


• 

p65 
p64 








• 


f 

39% 
27% 


Banking services 


• 


• 


50% 


d 

36% 
hl9% 


84% 


d 


p29 


• 






• 


d 

51% 

52% 
31% 


Obtaining mortgages 


























Determining the most pro- 
fitable way to save money 
























31% 



er|c 4i 



Consumer Economics (continued) 



Study 

ObiGctiuG 


APL-Based Studies 


Studies Not Limited to APL 


APL 


NWREL, USOE 
Region X 


N.J. 
ABE 


N.J. 
ESL 


Penn. 
ABE 


Alaska 


Utah 


Adkins- 
Conn. 


NY. 


Calif. 


NCRVE 


65 
obj 


41 

KJKJj . 


Understanding credit systems 

Establish a credit rating 
Bank loans 

Financing through a store 


• 


• 


• 

58% 


• 

20% 
h20% 


9 

73% to 
79% 
Several 
items 


0 


• 

p36 


• 




® 


• 


0 

30% 
36% 
28% 
28% 


Understanding and selecting 
insurance 


• 


• 


• 

71% 


9 

46% 
hl9% 


(B 

78% 




• 

p8 


• 


• 




• 


• 

30% 


Fraudulent practices; 
resources for protection 


• 


• 


• 

68% 


• 

62% 
hl7% 




• 


• 

p3 


• 


• 




• 


9 

24% 
30% 
27% 


Consumption of world 
resources; individual's 
responsibility 


• 


• 


• 

53% 








• 

p52 


9 






• 


9 

27% 



ERIC 



SUMMARY OF COMPETENCIES. PART 3: 
MAJOR OBJECTIVES BY COMPETENCY AREA 



Occupational Knowledge 





APL-Based Studies 


Studies Not Limited to APL 


Study 


APL 


NWREL, USOE 
Region X 


N.J. 
ABE 


■ NJ. 
ESL 


Penn. 
ABE 






Adkins- 
Conn. 








Objective 


65 
obj. 


41 
obj. 


Alaska 


Utah 


N.Y. 


Calif. 


NCRVE 


Sources of employment 


• 


• 




O 

27% 
h24% 


• 

79% 
74% 
75% 


CB 


• 

pl3 
o 
p63 


• 


• 


• 


• 


• 

26% 


Requirements of different 
occupations 


• 








• 

84% 
77% 
81% 


9 


• 

pl6 

o 
p 10 


• 


• 


(• 


• 


• 

29% 
40% 


Occupational interests 
(testing and counseling) 


• 


• 




• 

44% 
h25% 


• 

85% 




c 
pl6 
p24 


• 


• 


(• 


• 


• 

40% 


Private and other employmGr t 
agencies 


• 


• 






• 

75% 




• 

p27 
o 
p24 


• 


• 


o 


• 


• 

26% 


Job applications and inter- 
views 


• 


• 




• 

46% 
h27% 

31% 
h24% 


• 

82% 
79% 
62% 
91% 


• 


• 

p54 
p20 


• 


• 


® 


(• 


(• 

29% 
28% 
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Occupational Knowledge (continued) 



^""^^^..^^ Study 




APL-Based Studies 


Studies Not Limited to APL 




APL 


NWREL. USOE 

Rpoinn X 


N.J. 

ARF 


N.J. 

COL, 
















Objective ^N,^^ 


65 

obj. 


41 

obj. 


Penn. 

ARC 


Alaska 


Utah 


Adkins- 
Conn. 


N.Y. 


Calif. 


NCRVE 


Standards of behavior for 
types of employment 


• 


• 




• 

34% 
h 19% 






O 

P 5 
p44 


• 


• 


3 


• 


• 

37% 
51% 
32% 

/I /I qr 

45% 
48% 


Attitudes and skills that 
may lead to promotion 


• 


• 










• 

p5 
p6 


• 


• 




• 


• 

Range 
from 
20- 
35% 


Financial and legal aspects 
of employment 


• 


• 




o 

46% 
h 19% 

53% 
h22% 


m 

84% 
77% 
81% 
71% 
77% 




o 
p9 


• 




o 




24% 
33% 
18% 
19% 
22% 


Aspects of employment other 
than financial that affect 
job 


• 








• 

77% 
66% 
63% 




• 

p56 


• 


• 


3 


• 


40% 
32% 
51% 
27% 
39% 
28% 



^1^ 
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SUMMARY OF COMPETENCIES, PART 3: 
MAJOR OBJECTIVES BY COMPETENCY AREA 



Community Resources 



Study 

Objective ^v,^^ 


APL-Based Studies 


Studies Not Limited to APL 


APL 


NWREL, USOE 
Region X 


N.J. 
ABE 


N.J. 
ESL 


Penn. 
ABE 


Alaska 


Utah 


AdkinS" 
Conn. 


N.Y. 


Calif. 


NCRVE 


65 
obj. 


41 

obj. 


Types of community resources 


• 


• 










p49 


• 


• 


• 


• 




How and when to apply for 
community services, such as 
social security and medicare 


• 


• 




• 

40% 
h22% 






• 

p71 


• 


• 


3 


• 




Recreational services 


• 


• 




• 

13% 
h 16% 






• 

p59 


• 


• 


3 


• 




Informational services 
(e.g., media, telephone, 
library) 




• 




• 

44% 
h30% 






• 

p49 


• 




o 


• 




Resources for acting on 
citizens complaints 


• 










o 


3 

P 3 
p35 


• 


• 


3 


• 


3 

27% 


Recognize traffic signs, 
driving regulations, safety 




• 




• 

17% 
hll% 

27% 
h 14% 






• 

p66 
p72 




• 


3 


• 




Transportation schedules, 
fares, informational resources 


• 


• 




• 

10% 
hl5% 




• 


• 

p75 


• 


• 


o 


• 
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Community Resources (continued) 







APL-Based Studies 


Studies Not Limited to APL 
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SUMMARY OF COMPETENCIES, PART 3: 
MAJOR OBJECTIVES BY COMPETENCY AREA 



Health 
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Health (continued) 
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SUMMARY OF COMPETENCIES, PART 3: 
MAJOR OBJECTIVES BY COMPETENCY AREA 
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SUMMARY OF COMPETENCIES, PART 4: 
ADDITIONAL COMPETENCIES 



Utah Study 

Major Objective: Consumers* Role In the Economy 

Enabling Objectives 

•Should recognize that in a free enterprise economy expenditures amount to an economic 
vote for type and quality of goods 

•Must recognize that by becoming an efficient and effective decisionmaker they will improve 
society's allocation of resources 

•Fundamentals of how a free economy works and how the role of consumer affects overall 
market structure 

•Knows importance of effective and efficient decisionmaking, management concepts and 
techniques 

Major Objective: Introduction to Life Cycle / Life Style Concepts 

Enabling Objectives 

•Awareness that life cycle positions have effect on problems individuals face 

•Should understand the life cycle concept and its effect on life style or personal consumption 

•Recognize that life cycle analysis can be effective planning aid 

Major Objective: Telephone Services 

Enabling Objectives 

•Should be aware of total costs of telephone service and habits which can save money 
•Needs to know how costs vary with types of service 
•Awareness of advantages that telephone services offer 

•Awareness that vendors other than phone company distribute telephone equipment 
Major Objective: Wills 

Enabling Objectives 

•Parents and persons with substantial assets have obligation to prepare a will 

•Consumers should believe that it is important to have estate plans reviewed periodically by an 
attorney 

•Consumer should know what legal skills vary automatically from one attorney to another 
•Should know the basic laws of descent and distribution 
•Should know how gifts, trusts, and estates are taxed 
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SUMMARY OF COMPETENCIES, PART 4: 
ADDITIONAL COMPETENCIES 

Adkins-Connecticut Study 

Major Objective: Problems of Living in the Community 

Enabling Objectives: 

•Dealing with conflicts between own children and neighbors' children; also dealing with un- 
reasonable neighbors 

•Special problem of recent unemployment and the maintenance of housing 

•Overcrowding, particularly for families with many children, exacerbates family conflicts and 
tensions 

•Fear of danger from others on dark nights going to and from public transportation 
•People on welfare do not have adequate resources for transportation to and from school 
•Psychological consequences of lack of adequate transportation 
•Dealing with school boards and school officials 

•Not feeling a part of the community through participation in community 
Major Objective: Problems of Being a Parent 

Enabling Objectives 

•Disappointment with the school system 
•Misdiagnosis of child as having a learning disability 

•Dealing with special problems of retarded, physically handicapped, or hyperactive children 

•Helping handicapped children with feelings of rejection and exclusion 

•Getting help in dealing with handicapped children 

•Finding out about day care facilities 

•Identifying responsible people to care for children 

•Need for babysitter or day care in order to go to school or work 

•Lack of after-school and summer programs for children 

•Adult at lower educational level than children feels inferior 

•Dealing with separation, divorce, or desertion 

•Dealing with lying, theft, and sneaky behavior 

•Dealing with neighbors* children and neighbors 

•Problems of child abuse 

•Helping children with problems of death 
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Adkins-Connecticut Study (continued) 



Major Objective: Marriage and Family Problems 

Enabling Objectives 

•Deterioration of marital relationship and family life after prolonged unemployment 
•Helping one s spouse deal with feelings of failure due to unemployment 
•Husband takes out frustrations on wife and family 

•Money problems are major source of argument between husband and wife 
•Conflicts over raising children from a previous marriage 
•Difficulties of divorce 

•Difficulties in meeting someone of the opposite sex 

•Unemployment and loss of income makes household management extremely. difficult 
Major Objective: Occupational and Career Probleris 

Enabling Objectives 

•Belief that fate or chance determines what job you get and in an inability to affect destiny 

•Limited access to on-job-training programs, summer employment, etc. 

•Problems that prevent certain groups from enrolling in educational and training programs 

•Need for training leading to taking correspondence and inevitably failing 

•Lack of coordination between employment and training agencies 

•Difficulty in communicating with physicians 

•Impersonalness of doctors 

•Lack of concern by doctors about medical aid patients, and refusal to see welfare patients 
•Inability to get any doctor to come to the house 

Major Objective: Problems in Relating to Others 

Enabling Objectives 

•Knowing how to interpret the facial expressions of others 

•Giving in to children's wishes because of peer pressure 

•Dealing with discrimination because of being too short, fat, or a minority 

•Avoiding opportunities because of fear of being discriminated against 

•Discrimination against women in employment 

•Dealing with and resolving conflicts between different kinds of life demands 
•Difficulty in balancing home and family responsibility and responsibility to self 
•Feeling that there are very few places that one can admit one's ignorance 
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SUMMARY OF COMPETENCIES, PART 4: 
ADDITIONAL COMPETENCIES 

New York External Degree Program 

Major Objective: Self-Awareness 

Enabling Objectives 

•Apply the decisionmaking process 

•Identify one's own values, goals, roles, and needs 

•Awareness of art in everyday life 

•React to or create an exhibit 

•React to a live performance 

•Identify uses of music to manipulate emotions 

Major Objective: Social Awareness 

Enabling Objectives 

•State contributions of a different culture to American life 

•Use history in making decisions or plans 

•Function within a group 

•State the effects of one group upon another 

•State the relationship between the individual and the environment 

•Communicate in a socially acceptable manner 

•Recognize and share fundamental assumptions and world views about concepts such as fair- 
ness, truth (philosophy, science, history) 

•Identify the diseases and other health problems associated with one's family 

•Recognize normal physical and emotional changes associated with various states of life 

•Make family decisions with family members 

•Recognize social norms in a variety of situations and exhibit cooperative skills for participating 
in social life— get along with others 
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SUMMARY OF COMPETENCIES. PART 4: 
ADDITIONAL COMPETENCIES 



California Study 
Major Objective: Occupational and Career Problems 

Enabling Objectives 

•Problems that prevent certain groups from enrolling in educational and training programs 
•Use the tools and equipment the job calls for 
•Follow rules and policies 

•Use material and knowledge of other people to develop job interests 

•Manage one's own time and activities 

•Use the reading and math skills the job calls for 

Major Objective: Relating to Others 

Enabling Objectives 

•Dealing with discrimination because of being too short, fat, or a minority 

•Discrimination against women in employment 

•Knowing how to interpret the facial expressions of others 

•Use history in making decisions or plans 

•State contributions of different culture to American life 

•State the relationship between the individual and the environment 

•Communication in a socially acceptable manner 

•Recognize and share fundamental assumptions and world views about concepts-fairness 
truth (philosophy, science, history) 

•Identify the diseases and other health problems associated with one's family 
•Recognize normal physical and emotional changes associated with various stages of life 
•Make family decisions with family members 

•Be aware of life cycle positions and their effect on planning future, solving problems, life style 
and personal consumption patterns 

Major Objective: Being a Successful Consumer 

Enabling Objectives 

•Decide if a more expensive item is worth the extra cost 

•Decide what gives you the best return (or profit) on your money, if you want to save money 
•Understand how changes in the economy make a difference in how much you have to spend 
•Establish a credit rating 
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California Study (continued) 



•Get a mortgage on a house 

•Fix things when they break or tear 

•Find the right person to sell something to you 

•Be able to when you are not getting satisfactory service (as from doctors, lawyers, 
mechanics, etc.). 
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SUMMARY OF COMPETENCIES, PART 4: 
ADDITIONAL COMPETENCIES 

National Center for Research in Vocational Education 

Major Objective: Adaptability in the World of Work 

Enabling Objectives 

•Use the tools and equipment the job calls for 

•Follow rules and policies 

•Persuade others to one's way of thinking 

•Use material and knowledge of other people to develop job interests 

•Ask for a raise in salary 

•Manage one's own time and activities 

•Use the reading and math skills the job calls for 

Major Objective: Being a Successful Consumer 

Enabling Objectives 

•Decide if a more expensive item is worth the extra cost 

•Decide what gives you the best return (or profit) on your money, if you want to save money 

•Understand how changes in the economy make a difference in how much you have to spend 

•Establish a credit rating 

•Get a mortgage on a house 

•Fix things when they break or tear 

•Decide between selling something large yourself, such as a house or car, or having someone 
sell it for you 

•Find the right person to sell something to you 

•Decide between renting or buying something you may not need very often 

•Be able to tell when you are not getting satisfactory service (doctors, lawyers, mechanics, 
etc.). 
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THE APL STUDY: SCIENCE, 
DISSEMINATION, AND THE 
NATURE OF ADULT EDUCATION 



Education is America's magic... If the economy is to sustain, some development 
dollars must be reinvested in adult education. We believe this is the best application 
of dollars for investment in order to return to the society the magic multipliers of 
American adult education. 

William Flowers and Linda Hartsock 
representing the Adult Education 
Association and the National 
University Extension Association 
in testimon}^ before the United States 
Congress, 1977. 

If education is America's magic, then adult education is surely an important and growing 
part of the show. Since passage of the Adult Education Act of 1966, enrollments in adult 
education state grant-supported programs have grown from around 380,000 to more than 1.2 
million in 1975 (U.S. Congress, 1977, p. 105). According to data from the National Center 
for Education Statistics (NCES), the number of adult education participants grew from 8.3 
million in 1957 to 18 million in 1975 (Golladay, 1976). 

This remarkable growth has been coupled with an upsurge of interest in a new form of 
adult education— namely, competency-based adult education. Malcolm Knowles, in his 
History of the Adult Education Movement in the United States (1977), has described this new 
interest and one of the major motivations behind it. 

The greatest swell of competency-based education for adults... occurred following 
the report of the findings of the Adult Performance Level (APL) Study in October, 
1975. Funded with $1 million from the Office of Education's Adult Education Divi- 
sion, the first phase of the Study— an assessment of the functional competency of 
American adults— took just over four years to complete. Its general finding that one 
out of five (19.8 percent) adults lacked the skills and knowledge needed to function 
effectively, another 33.9 percent were marginally competent, and only about 46.3 
percent were functioning with any degree of real competence, jolted the educational 
world.... 
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Even before the Study was completed many state departments of education and 
local school systems had started developing APL competency-based programs and 
rnatenals and conducting workshops to help teachers become competent in using 
the new approach. 

Despite its widespread impact, the APL project has been subjected to relatively little 
M Q7A "I'^o^^.^x, r principal critical reviews of the APL project are by Griffith and Cervero 
(1976, 1977), Nafziger et al. (1975), and Heller et al. (1978). Ronald Cervero, for example 
has argued that the key assumptions of the APL study rely on "faulty reasoning," and he has 
concluded that the APL test does not measure "functional competence but is really iust a test 
of the three R's" (Cervero, 1980). ' 

The juxtaposition of this growth and strong criticism is the subject of this paper Our 
question is simple: If APL has the flaws tha^t its critics say it has. why has it had such a pervasive 
impact on adult education in this country? We begin in section 1 by summarizing the APL 
study and its history. In section 2. we outline the criticisms of the APL study. And in section 3 
we consider why. despite serious shortcomings, the APL study has caused such an apparent 
upheaval in adult education. We go on to suggest that these considerations raise important 
questions concerning both the recent enthusiasm for competency testing in American educa- 
tion and the means by which educational ideas and innovations are communicated and in- 
fluence educational endeavors. 

One important distinction should be made clear at the outset. In sections 1 and 2 we limit 
our attention to the original APL study and tests developed on the basis of that study and 
published by the American College Testing Program. We do not comment on APL curriculum 
materials that have been developed subsequent to the APL study. This distinction is important 
because many of the criticisms leveled against the APL study and tests are not necessarily rele- 
vant to APL curriculum materials. Indeed, as we show in section 3. some of the assumptions 
implicit in APL curriculum materials are contrary to those embodied in the APL study and test 
and are. we think, more appropriate for the diverse needs and concerns of adult learners 



1 . The APL Study and Its Progeny 

One out of five American adults lacks the skills and knowledges (sic) to function ef- 
fectively in the basic day-to-day struggle to ^nake a living and maintain a home and 
family. 

HEW NEWS. U.S. Department of Health. 
Education and Welfare, 10-29-75. (quoted 
in Heller et al.. 1978) 

What led the Department of Health. Education, and Welfare to issue such a proclama- 
tion? If true, surely such a state of affairs is as worrisome as an unemployment rate of 20 per- 
cent. For this news release says not just that adults lack jobs or lack skills for jobs, but that they 
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lack the requisites to function effectively in life. To explain this astounding conclusion, we go 
back to the origins of the APL study. 

Origins of the APL Study: 1970 1973 

In August 1970, the Division of Adult Education of the U.S. Office of Education (USOE) 
issued a Request for Proposals for a research project that would establish an adult education 
system based on a new definition of adult functional literacy. The RFP explained: 

The challenge is to foster through every means the ability to read, write, and com- 
pute with the functional competence needed for meeting the requirements of adult 
living. The emphasis of this definition is on its final phrase, ^^requirements for adult 
living." These requirements must be determined by an analysis of adult living rather 
than the common practice of attaching a grade equivalence to them,... A system of 
adult education must derive its own specific aims and have its own adult based cur- 
ricula, methodologies, and materials. (Quoted in Final Report, APL Study, 1977.) 

In the summer of 1971, a contract for the project was awarded to the Texas State Educa- 
tion Agency, which in turn subcontracted most of the work to the Division of Extension of the 
University of Texas at Austin. On the basis of "a review of related literature and resf^arch," **an 
extensive survey of state and federal agencies and foundations. ' **a series of conk .rences on 
adult needs... in different areas across the country," and "a series of semi-structured interviews 
with undereducated persons... in the Austin area," the project staff developed a taxonomy of 
areas of need ^^particularly appropriate for the undereducated adult." 

The taxonomy consisted of a matrix of basic skills and general knowledge areas in which 
each of the basic skills might be applied. The basic skills were communication (reading, writing, 
speaking and listening), computation, problem solving, and interpersonal relations.' The 
general knowledge areas were occupational knowledge, consumer knowledge, health, com- 
munity resources, government and law, and transportation. The project staff explained this 
two-dimensional approach to defining adult competencies as follows. 

(T)he basic skill areas play a major role in defining the minimum level of perform- 
ance within each of the general knowledge areas. The attainment of the basic skills 
in themselves do not (sic) distinguish the successful from the unsuccessful, however 
the application of these skills within each knowledge area help define the minimum 
level of performance that an adult must obtain. {Adult Performance Level Stud^, 
1973) 

In order "to define Afunctional* literacy in terms of observable behaviors in certain skills 
relating to a set of needs which have been identified as being important to ^success' in adult 
lile," (APL Study, 1973), two steps were deemed essential. First, the inquiry would need to 
construct criteria by which '^success" in society might be measured and in terms of which the 
adult competencies might be validated. Second, the behaviors presumed to represent adult 
competence must be shown to be empirically related to the criteria of success. 



"The 1973 APL report refers to communication skills apparently as encompassing reading, writing, spe; ^ing and 
listening, and computation. 
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To accomplish this. APL project staff undertook a field study to validate possible adult 
competence measures in terms of success in society. The 1973 APL study report explains that 
three types of variables afforded measurable indexes of success: "occupational prestige 
weekly income, and level of education." the latter considered both in terms of level of adult 
oasic education and years of formal schooling. 

Having developed the taxonomy of adult competencies in terms of a matrix with basic 
ski! s on one dimension and knowledge areas along the other, the project staff constructed 
lists of adult-hfe situations in each area of need." Test items developed from this list were then 
administered to a sample of some 4.000 adult volunteers, most of whom were participants in 
adult education programs, in 30 states. 

The 1973 report does not make clear exactly how test items relevant to "adult-life situa- 
hons in each area of need" were developed or selected, nor exactly how many items were field 
tested The report simply presents a "revised list" of adult performance items that was 
developed from the initial list and from analysis of the test data." The bulk of the 1973 report 
(almost 200 out of 280 pages) consists of "field validation results" discussed in terms of the six 
APL knowledge areas. 

Although the report emphasizes the matrix approach to defining adult competence in 
terms ot both skills and knowledge areas, the presentation of results dispenses with the skill 
dimension in a single .nntence: "Performance in terms of basic skills of reading, writing and 
computation are included within the following discussion" of knowledge area results (The final 
APL report, however, does deal with both dimensions.) Field trial results are presented item- 
by-item for some 170 items grouped into the six knowledge areas. For each item, percentages 
ot the trial sample providing correct responses are reported in terms of different levels of each 
adult success criterion variable. Chi square scores were calculated to ascertain whether results 
on each item showed a statistically significant relationship with the criterion variables All 175 
Items showed a significant association with one or more of the criterion variables. 

'nrnHnl-T ^ Validation results, the 1973 report presents the "most important 

product of the first year of work in the APL study," namely. APL goals, objectives, and tasks 
The report explains simply that this listing constitutes "requirements for adult living which we 
have tentatively identified as contributing to success in adult life (in the sense of being positively 
related to various criteria for success) ." The report concludes: 

For the first time, there is a body of research which offers guidance on what we 
should be teaching our students in ABE. This project has defined a s^/stem of adult 
needs and has described an arra^/ of behauiorial tasks kexjed to these needs which 
for the most part can be demonstrated to be positively; related to various measures of 
success m adult life. (Emphasis in original.) 

APL Project, Phase Two: 1973-1975 

The second phase of the APL project began in 1973 and is reported in Adult Functional 
Cornpetenci,^A Summary; (1975) and in Final Report: The Adult Performance Level Study, 
(1977). On the basis of the field validation, the framework for defining adult competence and 
the Items for measuring it were refined. The new framework retained the skills and knowledge 
area matrix and encompassed the same skills: communication, computation, problem solving 




and interpersonal relations. The knowledge areas dimension had one less area, now consisting 
of occupational knowledge, consumer economics (rather than knowledge), community 
resources, government and law, and health. Why transportation was dropped as a separate 
knowledge area was not explained in either the summary report or the final report, but it ap- 
parently became part of the community resources knowledge area. 

The revised set of adult competency test items (or performance indicators as they 
sometimes were called) was administered to a representative sample of 7,500 adults 
throughout the continental United States, and three competency levels were determined in 
terms of performance on the APL test items. These three categories— termed APL levels 1, 2, 
and 3— are described in table 1. These levels are described as '^conjoint" definitions **based on 
predicted income, education and job status,'' but nowhere does the final report describe how 
the three variables were treated '^conjointly." 

On the basis of the national survey and these definitions of aduit performance levels, the 
final report concluded: 

In general, the answer to the question posed by this section is **nct as competent as 
we thought." Overall, approximately one-fifth of U.S. adults are *7uncf/ona//y in- 
competent. This estimate is based on a representative sample of adults performing 
on indicators which cover the five general knowledge areas and four skills. When 
broken into the individual knowledge areas and skills, this level of incompetence 
(APL 1) ranges from 16% for writing to 33% for computation. Thus, at least for one 
of the skills deemed important for survival in society, about one-third U.S. 
adults are incompetent. 

The report goes on to discuss performance level results for each of the five knowledge and 
four general skill areas, and variations in overall results in terms of years of education, family 
income, occupation, sex, age, region of the country, ethnicity, size of household, and employ- 
ment status. With respect to ethnicity, the report states: 

While less than 20% of the Whites were estimated to be functionally incompetent, 
more than 40% of the Black and Spanish surname groups were estimated to be so. 

Apparently based on the findings from the second phase of the APL study, HEW issued 
a press release in the fall of 1975 stating that, **One out of five American adults lacks the skills 
and knowledges to function effectively in the basic day-to-day struggle to make a living and 
maintain a home and family" (Heller et al., 1978). 

Initial Reactions to APL Study 

The study and its findings roused considerable attention. The title of Edith Roth*s lead arti- 
cle in the May 1976 USOE-published journal American Education credited the study with 
causing "A Ferment in Education." She wrote: 

Today— not quite five years since the APL study began— more than 30 states are 
either gearing up to teach or are already teaching adults to gain competency in the 
65 practical objectives which the University of Texas team developed. 
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TABLE 1 

DEFINITIONS OF APL PERFORMANCE LEVELS * 

APL 1 

(Least Competent Adults) 
APL Ts are those adults whose mastery of competency objectives is associated with: 

1. Inadequate income— poverty level or less 

AND 

2. Inadequate education— 8 years of school or fewer 

AND 

3. Low job status— unemployed or unskilled. 

APL 2 

(Marginall]^ Competent Adults) 
APL 2*s are those adults whose mastery of competency objectives is associated with: 

1. Marginal income— more than poverty but no discretionary income 

AND 

2. Marginal education— 9 to 11 years of school 

AND 

3. Semiskilled to upper-level blue collar and sales job status. 

APL 3 
(Most Competent Adults) 

APL 3's are those adults whose mastery of competency objectives is associated with: 

1. Highest levels of income— varying amounts of discretionary income 

AND 

2. Highest levels of education— high school completion or more 

AND 

3. White collar or professional-management job status. 



Mt should be noted that the definitions cited here are different than those given in Adult Functional Competen 
Summary. Why Is unclear. 

Source: Final Report: The Adult Performance Level Sfudy (1977), pp. 16-17. 
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A 1977 report by USOE's Bureau of Occupational and Adult Education listed 120 current 
Adult Performance Level and adult competency educational projects in 34 states. 

The APL approach was not only popular with adult educators around the country, but 
also received the seal of approval from the Joint Dissemination Review Pane! (JDR?> in 
HEW's Education Division in March 1975. ' As a result, the APL study was subsequently listed 
in the 1976 USOE-sponsored catalog of exemplary educational programs, Educationat '^'ro 
grams That Work. Summarizing the evaluation evidence that led to JDRP approval, the 
catalog reports: 

Items developed from APL objectives were field tested on random samples of adults 
over 18 in the U.S. Five such surveys were conducted, objectives were obtained 
through interviews with business, industrial, and educational personnel, prospective 
employers, and target audiences; expert opinion; and literature research. 

Given widespread national interest among adult educators and JDRP approval, the APL 
study offered an opportunity for commercial enterprise. In March 1975, USOE and the 
University of Texas at Austin entered into an agreement with the American College Testing 
(ACT) Program under which ACT received the "exclusive right to refine, adapt, publish, and 
distribute the APL materials.'" ' As Griffith andCervero (3.977) observed: 

Under the ACT framework emphasis was placed upon developing a test that would 
be entirely written, whereas the Texas version had included an oral portion to 
measure speaking and listening. 

As implemented by ACT, the "APL Program" consists of six instruments: an Adult Per- 
formance Level General Survey (containing 40 multiple-choice items and available in both 
adult and high school forms), and five Content Area Measures, one each in community 
resources, occupational knowledge, consumer economics, health, and government and law 
(each containing between 42 and 66 items, for a total of 249 items in all five content area 
measures). ACT promotional material describes the rationale behind the APL Program in 
terms similar to those of the original APL project: 

Because APL assessment items are linked to specific objectives and tasks drawn 
from everyday life. APL measures can assess functional competence more directly 
than traditional achievement tests. 

The operational matrix with which the APL program functions is related to five life 
skills and five general content areas. (ACTP, 1977) 



•The JDRP reviews evidence of the effectiveness of educational programs, practices, and products developed 
under Federal auspices prior to the expenditure of Federal funds for disseminating approved programs, practices 
or products. 

• •APL curriculum materials currently are being published separately by Harcourt Brace Jovanovich under the title 
"The APL Series.** These are discussed in section 3. 
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The ACT matrix, like that of the second phase of the Texas APL project, listed commu- 
nity resources, occupational knowledge, consumer economics, health, and government and 
law on the content area dimension. But unlike the Texas matrix, it listed identification of facts 
and terms, reading, writing, computation, and problem solving on the skills dimension. For 
the ACT Program, the "identification of facts and terms" skill was added and the "interper- 
sonal relations" skill dropped, apparently to accommodate the multiple-choice paper-and- 
pencil format that is employed for ACT's APL instruments. 

From such a practical point of view, it is easy to see why this skill switch was made. One 
might wonder, however, whether "functional competence" which includes interpersonal rela- 
tionship skills and excludes identification of facts and terms skills is the same as "functional 
competence" which does the reverse. However, before we get too far into such specific ques- 
tions, we will explore the broeder literature critical of the APL study and the tests resulting from 
it. 

2. Second Thoughts 

The preceding account would indicate that the APL study was a highly successful under- 
taking: a 4-year research study resulting in widely publicized findings; approval by the JDRP as 
exemplary; adoption of APL materials into adult education endeavors in dozens of states 
around the country; and publication of six APL testing instruments as a commercial enterprise. 

But even as these events were occurring, several observers began to ask questions about 
the APL endeavor. Although their comments have received relatively little attention, five 
critics— Acland, Cervero, Griffith, Heller, and Nafziger— seem to have raised significant and 
fundamental questions concerning the APL enterprise. These critics address the APL study 
from a variety of perspectives. 

Criticisms of APL 

Griffith and Cervero (1977) have suggested that the APL study is historically and educa- 
tionally shortsighted. "The belief that the APL approach is novel," they wrote, "is simply 
naive. The main characteristics of the concept have historical precedents extending back over 
a hundred years." 

Griffith and Cervero traced efforts to define educational objectives in terms of the 
demands of contemporary life back to an 1861 inquiry by Herbert Spencer. They also cite, 
without elaboration, Ralph Tyler's 1950 admonition that "studies of contemporary life are but 
one of the sources of objectives for the school curriculum and... any curriculum that drew only 
upon one of those sources was theoretically deficient." They mention four factors behind the 
historical rejection of the life-skills approach to curriculum development: 

•The endless proliferation of goals and objectives to which this approach leads. 

•The emphasis of the progressive education movement on the individual learner. 

•Calls for a return to the critical dialectic approach to education as opposed to the life 
adjustment approach to learning. 

•The requirement that the curriculum designer decide in advance which types of 
people are "good citizens, good parents or true believers." 
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Griffith and Cervero's point that the APL test "exemplifies a philosophy of adjustment to 
the existing society in that it prepares people to perform the functions which are defined by the 
developers as necessary for success in society" is reflected in several other criticisms of the APL 
endeavor. For example, Heller et al. (1978), in their critical description and analysis of the 
APL study and of curricula and programs that reflect the APL findings, observe: 

The major problem, as we see it, was whether the APL study was an attempt to 
generate competencies that are essential to survival or competencies essential to 
success.... (T) here are important differences (methodological, pedagological, and 
philosophical) in whether adult functional competency is conceptualized as meaning 
skills and knowledge associated with success in contemporary society or whether 
one means the essential minimal skills and knowledge requii'ed for survival in con- 
temporary society. 

These critics point out that the APL study attempted to have it both ways, and, as a result, con- 
fusion regarding this distinction "permeates all published reports." For example, the field 
validation phase of the APL study was aimed at showing significant positive associations be- 
tween results on the APL test items and respondents' "success" in society as measured in terms 
of education, income, and occupational status. Then, after defining the three APL levels 
without much explanation,' the APL investigators turn around and interpret the results as 
showing that certain adults are "functionally incompetent." This conclusion is, we believe, ar- 
bitrary—a product of the study's failure to distinguish between "incompetence" and low levels 
of success, both of which were determined by the limited criteria of education, income and oc- 
cupational status. 

Reviewers have also criticized the ways in which the APL survey data were analyzed and 
interpreted. The first comment on this aspect of the APL study, as far as we know, was by 
Acland (1976). He begins by noting the assumption underlying the enthusiasm for life-skills or 
competency testing: "Any test of competency assumes we can judge what it takes to get by, 
and having judged it, can measure it." Voicing dissent about this assumption, he notes two 
main problems with it: (1) people do not face the same problems; and (2) there are a variety of 
ways of solving a problem. Acland goes on to discuss three APL items to show how hard it is to 
find life-skills problems that all people actually encounter in their lives. The results on three 
other items illustrate that people do, in fact, have different avenues to problem solving, even 
when they face the same problem. 

One APL item that Acland analyzed asked people to use a inock airline schedule to select 
a flight so that they could make an appointment in another city at a particular time. According 



"The APL final report explains that, Tor those of you who are statistically Inclined, Appendix C contains an ex- 
planation of the procedure used to create the APL levels." But when one turns to Appendix C, all that is provided 
is an introductory-textbook-level explanation of Bayes Theorem in terms of drawing red and black bails from urns: 
there are no details regarding the basis on uh\ch the three APL levels were defined. A recent paper by Williams 
(1977) addresses the problem of setting cut-scores for defining the three APL levels in more detail. From the 
description in the Williams paper (in Bunch, 1978), one might raise some serious questions about Williams* ap- 
proach, but since we have not been able to obtain a copy of the Williams paper, we withhold further comment. 
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to the APL study, 30 percent failed to choose the correct answer. * As Acland notes, the APL 
developers apparently assumed that the airline schedule item measured some general life-skill 
or competence. Nevertheless, Acland observes: 

(T)he case can be made that there are skills which apply to checking airline 
schedules which are not necessary for other tasks. In that case it is pertinent to ask 
how many people use airlines. In September 1974, only one person in two (55 
percent) had ever flown (Gallup, 1974). This makes the ''bad" result look a lot less 
depressing; it [the APL finding] now seems to reflect differences in the tasks people 
face rather than differences in their problem solving skills. 

To illustrate his point regarding different ways in which people solve the same problem, 
Acland cites results on an APL item indicating that only 39 percent of the population could 
correctly complete calculations for a partially completed Federal income tax form 1040 when 
provided with the pertinent information. In contrast, he cites Internal Revenue Service data in- 
dicating that only about 6 percent of individual returns actually contain arithmetic errors of any 
kind. 

The reason that the APL results are much more discouraging is evident; in real life 
people get help. In fact, about half the individual returns are signed on the 
preparer's line, while a special survey undertaken for the IRS shows another 10-15 
percent got assistance and did not report it. So at least 60 percent of all returns are 
made with some kind of help. 

The two points raised by Acland are essentially questions of measurement validity— ones 
that are particularly crucial to any effort to assess life-skills competence. First, it cannot 
necessarily be inferred that a person lacks a particular skill simply because he or she is unable to 
demonstrate it in a particular situation or type of situation. Second, just because someone lacks 
a particular skill does not mean that he or she will be unable to deal with a problem in a par- 
ticular real life situation. In real life, and even on tests, people may bring very different skills to 
bear in solving the same problem. 

A more recent critique of the APL study has raised questions about the validity of the APL 
test as a measure of functional competence. Cervero (undated and 1980) has employed a fac- 
tor analysis approach and reports that his reanalysis of national survey results from an October 
1974 administration of the 67-item version of the APL test has produced the striking result that 
the test items measure no more than three independent dimensions. Also, when he examines 
the items that contribute to these independent dimensions, he suggests that the APL test is 
essentially a test of the three R's: 'The evidence suggests that individual's abilities in the three 
basic skills— reading, writing, and computation— probably account for a substantial amount of 
the variation in APL test scores." In addition, he observes: "Measurement of the three basic 
skills are also invariant with respect to the five (APL) knowledge areas." Cervero concludes: 



Acland s article does not make clear the source of the APL results he cites. In personal communication (August 
1979), however. Acland indicated that his source of APL data was computer printouts obtained directly from the 
University of Texas APL researchers. 
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''Based on the prii;riple of parsimony, the APL test should be considered a measure of those 
things which we are reasonably sure a paper and pencil test can measure— the three R's, rather 
than a construct which claims to represent the universe of behaviors which an effectively func- 
tioning adult must possess/* 

Another approach to assessing the quality of the APL test was adopted by Nafziger et al. 
(1975) in their review of adult competency tests. They used ^ method for assessing test quality 
developed by the Center for the Study of Evaluation (CSE) at the University of California at 
Los Angeles. Without explaining the details of this test rating scheme, note simply that 
Nafziger and his colleagues rated the Texas version of the APL test as good in terms of ex- 
aminee appropriateness, fa». in terms of measurement validity, but poor in terms of ad- 
ministrative usability and technical excellence (including zero ratings for concurrent and predic- 
tive validity, and test reliability). 

The low ratings resulted in part from the unavailability of certain teciinical data on the 
original Texas version of the APL test. Such data (particularly reliability data) are now available 
for the ACT version of the test. We should also point out that the CSE approach to rating test 
quality has been roundly criticized by some test experts as "incredibly subjective" (Anastasi, 
1978). 

If one does not agree with factor analytic approach, nor the concerns of measurement ex- 
perts for technical quality of tests, an alternative method of assessing the quality of a ter and 
what it measures is to look at "correct" responses to individual test items and assess their 
reasonableness and accuracy. This was one approach adopted by Heller et al. (1978). They 
commented on two of the original APL questions in the general knowledge area of govern- 
ment and law. 

[APL Study Director, Norvell] Northcutt writes: *'A shocking 34% of the (national 
assessment) sample felt that police had the authority to detain a suspect for as long 
as a week without bringing charges against him [not recognizing] the illegality of the 
situation." Because of the way the items and options are worded, there is no correct 
answer: "Under no circumstances" is not correct according to the Constitution of the 
United States which allows for the one exception f there is a state of martial law. 
This example is not meant to be lighthearted nor erudite: We include it as an illustra- 
tion of two problems that are common to the items. First, as an example of poor 
item construction and/or second, of an elitist value system that suggests that most 
people need not know "the full story." 

Let's examine another item and the findings included in the national assessment. 
"Concerning the right to peaceful assembly, 12 percent of the sample felt that per- 
mission to have public meetings should not be g ven to certain kinds of groups; e.g. , 
'radicals* and 'troublemakers.' " Clearly, the wording of this item asks the respond- 
ent for an opinion rather than th ^ constitutiowdl guarantee; the proportion ot 
"incorrect" responses may not be as surprising when interpreted in this manner. 
(Heller etal.. 1978) 
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Validity of the Criticisn.t 

This brief review )f criticisms of the APL study and the test deriving from it has touched 
only tht hig' lights. These five critics of the APL study and test collectively have charged that 
the APL study was; 

•Largely ignorant o' .arlier relevant literature. 

•Inconsistent in formulati- and describing the framework and philosophy guiding 
the inquiry 

•In error, factually, in formulating specific test items. 
•Incorrect in intemreting the meaning of test item results. 

•Incomplete in analyzing test results and documenting test quality, with the result that 
the very attributes that the test measured were misconstrued. 

Taken together, these assertions might add up to a devastating indictment of the entire 
APL study. What should be made of them? If we are to judge the APL study as a scientific in- 
quiry, these criticisms are, we think, essentially correct. We might quibble with some of the 
critics* arguments, and also with some of their documentation, but, essentially, their percep- 
tions of thv, APL study as a scientific undertakinq are sound. The authors of the APL study 
havj acknowledged some of these critics but have not responded to these criticisms in 
writing. • Nevertheless, these criticisms seem to be worthy of serious attention. 

We can illi 'strate our concer. about the APL study by focusing largely on thp 1973 report 
aud thereby show our concerns about: (1) the overall logic behind the study; (Z) the idea of 
success embodied in the study; and (3) the quality a. id validity of the APL test items. 

The first paragraph of the ^ 973 report states: 

(T)he APL study is an atte.-npt to define ^Afunctional" literacy in terms of observable 
behaviors in certain skills relai.ng to a set of needs which have been tentatively iden- 
tified as being important to "succes«^'' in adult life. 

One need only think of recert concern in our sc-iety for the handicapped, including the 
visually impaired and the blind, to wonder about the plausibility of this undertaking. Being able 
to see is. after all, a fairly fuiidamental ski'^ but it is by no mpans a skill requisite to success for 
al! people The comparison may seem unfair; one can, atter all, always find exceptions to 
general undertakings. Nevertheless, we think it illustrates a more general point of tremendous 
importance. In our variegated society, with its diversity of cultures and lirguistic and ethnic 
groups, there can be no one set of "uoserva' 1.^ behaviors i certain skills" tnat are eoually im- 
portant to ''success in adult life" for all peop.c^-- regard/ess of how succe- is defined. 

We are, in addition, more than a little uneasy with the way the APL study defined success 
in society— strictly in terms of income, education, and occupaiional status. 



'As far as we know, the only criticism that former APL Study Director Norvell Northcutt has responded lo is the ap- 
parent discrepancy as to whether the APL test measures success or survival skills. Dr. Northcutt has said that, oi the 
bottom end of the APL scale, the test measures survival skills, while in its upper ranges it measur. 3 success skills 
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The general assumption was that the more money a person makes, or the more 
education he has, or the higher status his or her job is accorded by our society, the 
more '^successful'' that person is. (Adult Performance Level Studi;, 1973) 

One need only reflect for a moment to realize that success encompasses more than years of 
schooling, income, and occupational status. ' These three things surely are important to many 
people's definition of success, but success can be had in any undertaking, not only in the seek- 
ing after money, schooling, and status. Indeed, the inclusion in the APL study of years of 
schooling as a measure of success and a validity criterion for the APL instrument is altogether 
ironic since the study began with a critique of previous definitions of adult literacy in terms of 
grade equivalence, noting among other points that "years of schooling completed generally 
overestimated actual achievement." 

Nevertheless, the bulk of thr 1973 report consists of item-by-item presentations of field 
trial results in terms of the three criterion variables, and the results for all of the 175 items 
show a statistically significant association with one or more of these criterion variables. 
However, the 1973 report also presents data, in an appendix, showing the relationships be- 
tween item results and several other background variables, including ethnicity, age, and city 
size. Table 2 presents a tabulation of these data showing the number and percentage of the 
APL items covered in the 1973 report for which results shov. a statistically significant associa- 
tion with the various background data reported by respondents. * * As indicated on the table, all 
(100 percent) of the field tested items show a significant association with years of school; 72 
percent with occupational prestige; and 43 percent with income. Yet a high proportion of the 
item results were associated with respondents' ethnicity (95 percent of the items), age (86 
percent), and city size (99 percent). The pomt of these data is that the APL items apparenti]; 
discriminated far more effectively; in terms of peoples ethfilriti;, age and c/fy size, than fhey 
did in terms of respondents' income, * * * 

These data suggest that a striking finding from the field trial was that the APL items 
discriminated relatively poorly in terms of respondents' income. This point is important 
because much previous research has shown that income is easily the most important determi- 
nant of status in the United States. Coleman and Rainwater (1978), for example, recently con- 
cluded that ''almost two-thirds of the variance in social status assigned by our respondents to 
hypothetical families described by income, occupation, and schooling was accounted for by in- 
come." 



'Griffith and Cervt>ro (1977. p 2151 observe that "a measure of expressed personal satisfaction with one's vocation 
and general status m life" was at one point considered as an additional '^riterion of success, but apparently was 
dropped by the APL developers early in the study. 

**The issue of the reliability of this sort of self-reported background data is not addressed in the APL report, but 
clearly is one that merits attention. 

* We should note that the relationship between test item results and background variables may have been affected 
by the way in which the latter wert collapsed by the APL study authors. (See pp. 11-12 of the 1973 study report,) It 
is unclear exactly how collapsing criterion variables affected the association between test item results and criterion 
variables. Methodological work on data aggregation suggests that it would artificially inflate such relationships, (See 
Blalock. 1961 ) 



67 



TABLE 2 



NUMBER (AND PERCENT) OF APL ITEMS (1973) FOR WHICH 
RESULTS SHOW A STATISTICALLY SIGNIFICANT ASSOCIATION 
WITH BACKGROUND VARIABLES 



Background Variables 



Knowlediji* 
Arpas 


Totai No 
of ItpnK 


Elhnicity 




Age 


Education 


Income 


Occupational 
Prestige 


City Size 


Occupational 


'37 






(W1 1,1 




15 (41%) 


18 (49%) 


37(100%) 


Lonsumer 
Economics 


50 


49 (98%) 


50(100%) 


42 (84%) 


50(100%) 


20 (40%) 


35(70%) 


48 (96%) 


Health 


8 


8(100%) 


8(100%) 


8(100%) 


8(100%) 


3(38%) 


7 (88%) 


8(100%) 


Community 
Rt'M^urct'S ' 


00 


22(100%) 


22(100%) 




22(100%) 


2 (9%) 


]H[H2%) 


22(100%) 


Government 
& Law 


35 


33 (94%) 


34 (97%) 


29 (83%) 


35(100%) 


21 (60%) 


26 (74%) 


35 (100%) 



Transportation 23 23(100%) 23(100%) 23(1(]0%) 23(100%) 14(61%) 22(96%) 23 



TOTALS 175 166(95%) 174 (99%) 150 (86%) 175(100%) 75(43%) 126(72%) 173(99%) 



Source: Summarized from Adult Performance Level Project Staff. The Adult Performance Level Study (Austin, Texas: Texas 
Education Agency, 1973) pp. 272-285. It is not made clear what confidence level was used for this report in deter- 
mining statistical significance, Hence, these data are simply summaries of results reported to be significant in the appen- 
dix tables of the 1973 report, Specifically, different portions of each exercise, which were scored separately, are treated 
as separate items. 
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Why is it that results for several dozen APL test items are associated with respondents' 
ethnicity, age, and City size more strongly than with their income? Since the authors of the 
1973 APL study report did not even acknowledge this fact, much less explore it, we have little 
way to address this question directly. Nevertheless, an examination of some of the APL items 
suggests some possible explanations. For example, one of the 1973 APL test items was: 

Mary Dilly is a housewife. She needs to make some extra money for a while. She 
can type, bake, and sew. The quickest thing for her to do to make money is to: 

a. Apply for temporary office work. 

b. Go to school. 

c. Bake a cake. 

d. Make her own clothes. 

e. 1 don't know. 

{The Adult Performance Level Study, 1973) 

Ostensibly, the "correct" answer to this question is option a. According to the appendix to the 
1973 report, results on this item were (statistically significantly) related to respondents' ethnic- 
ity and city size, but not to their income or occupational status. It is easy to imagine why blacks 
and Mexican-Americans may have selected the "correct" answer to this question in smaller 
proportion than did whites (which the appendix data indicate they did) simply because they 
may have experienced employment discrimination leading them to conclude that applying for 
a temporary job is not a way to earn quick money. This is, of course, pure speculation, but the 
important point is that the assertion that there is one "correct" answer is unrealistic. 

Other test items from the 1973 report are similarly ambiguous. This poor quality in test 
items persists in the ACT version of the APL test. Question number 13 on the ACT's APL 
Assessment Instrument (Form AA-1), for example: 

The city garbage truck has not picked up Esther Maxey's garbage for three weeks. 
Esther is having trouble keeping the flies and mice away. What should she do? 

a. Take the garbage down the street to an empty lot. 

b. Call the hospital to complain about the mice. 

c. Call the sanitation department about the problem. 

d. Cover the garbage with a sheet. 
(American College Testing Program, 1973) 

We suppose that the intended "correct" answer is option c. But given the infamous inefficiency 
of many cities' public services, a plausible argument could be made for other answers as well. If 
this test item measures anything at all, surely it is only the test-taker's ability to ferret out the 
item-writer's sense of social propriety. But the notion that this sort of test item measures "adult 
competence" or even competence in figuring what to do with one's garbage is altogether 
preposterous. 

We could go on, but we trust our point has been mad^>: As a scientific inquiry, the APL 
study was very weak. Even if we put aside doubts about the existence of a general construct of 
"adult competence," the much publicized finding that 20 percent of American adults are 
"functionally incompetent" on the basis of th2 design, conduct and reporting of the APL study 
is altogether untenable. We are reminded of the conclusions drawn in the early years of mental 
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tesHng in this country concerning the average mental age ot Americans. Our view of the scien- 
u Tf"l ^^""^^^^ conclusion paiallels that of Walter Lippman's on the idea, drawn 

by a Mr. Lathrop Stoddard some 57 years ago, that the mental age of Americans was only 14 
One need only substitute "functional incompetence" for "mental age'' to see the significance of 
Mr. Lippman's remarks for the APL study. 

(V:^e data themselves lead to no such conclusion. It is impossible that they should. 
It is quite impossible for honest statistics to show that the average adult intelligence 
of a representative sample of the nation ir that of an immature child in tb=^t same na- 
tion. The average adult intelligence cannot be less than the average adult in- 
telligence, and to anyone who knows what the words "mental age" mean, Mr. 
Stoddard's remark is precisely as silly as if he had written that the average mile was 
three-quarters of a mile long. 

The trouble is that Mr. Stoddard uses the words "mental age" without explaininc 
either to himself or to his readers how the conception of "mental age" is derived. He 
was in such an enormous hurry to predict the downfall of civilization that he could 
not pause long enough to straighten out a few simple ideas. The result is that he 
snatches at a few scarifying statistics and uses them as a base upon which to erect a 
glittering tower of generalities. For the statement that the average mental age of 
Americans is only about fourteen is not inaccurate. It is not incorrect. It is nonsense 
(quoted in Block and Dworkin, 1976) 

3. Science, Promotion, and the Nature of 
Adult Education 

If the scientific merit of the APL study is indeed as questionable as we su-.iqsX \ - id it 
cause such an upheaval in the world of adult education? One possible explaVuition h.-^ ^en 
suggested by Griffith and Cervero (1977), who point cut: 

The APL approach has been thoroughly and effectively publicized and pr -r^ovA y 
the U.S. Office of Education. It is not possible to point to any other devel - .t in 
the field of adult education which has been given as much sustained atteni. as has 
the APL project. 

USOE may have promoted the APL study for several reasons. »me critics h' ve charged 
that, from the very issuance of the 1970 RFP for a study of adult con^petence, USOE was 
committed to the proposition that the siady would lead to a statement of objectives for an adult 
education system around which an adult education curriculum and irjstructional material 
could be ^eloped. For example, Griffith and Cervero have commented that, "It seems 
remarkab^ that U.S. Office of Education personnel could be so certain in advance of the 
research they proposed to fund that this r^pprcach would undoubtedly be the chosen system 
(of adult basic educaiion) for :he United States." 

Sutn expectations, at least in -rm. oi he teri'?ts of educational research justification, may 
not be as unusual as Griffith and Cervero sugges:. in fact, much federally sponsored research 
on education is premised on the r.otion th-t it U;/: lead to improvements in educational prac- 
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tice. Such initial expectations should, of course, not preclude subsequent decision, 1 the ex- 
pectations will not be met. 

Why APL Spread 

As noted in section 1 , the APL study was approved by the JDRP in March 1 '^5 and listed 
in USOEs catalog of JDRP-approved projects (Educational Programs That Wc."J in 1976/ 
The APL study did not constitute an educational program. According to the APL submission 
to the JDRP, it represented a project to ''specify the competencies which aic 'anctional to 
economic and educational success in today s society and to develop devices ^cr assessing 
those competencies of the adult population of the United States.'' The APL submission went 
on to point out: "The APL project of itself is not a curriculum or demonsfratio^^ program or 
pilot project or a staffing plan, or a parental involvement program, or a i. ^sei vice/inservicc 
program or any of the other kinds of activities for which the disseminat;-^:) r .vu w guidelinvf 
were evidently developed." John Evans, a USOE official, later explain*? i: 

It is true that the APL is not an educational program. However, the staff o^ U.^ 01 
Adult Education Program has been making effoits to change the orie? n^ior ji 'ts 
projects from an emphasis on traditional, academically orlenter' basic skii. iridi^: ^ . 
(i.e., Dick and Jane readers) to emphasis on tlte achievement of functional litt>« 
measures like the APL. They th^ '•efore wanted to disseminate that technique, arn.^ :n 
order to do bO were required, ot course, to receive JDRP approval. (Evanh. 

Following^ JDRP approv/al, USOE moved quickly to promote the APL au^ oach. On 
April 23, 1975, that agency publislied rules and regulations in the Fedrva! /-? ^jistev governing 
Federal financial assistance to state adult education programs uiid^r -h^- Avult Education Act 
cf 1966. A section entitled ^^Establishment of national priorities in j Ja!: 'v'.iucation,'' stated: 

...the U.S. Office of Education will review and identify, for the 'a -dance of the state 
educational agencies and (sic) findings from other research con^munities, national 
priorities annually in the field of adult edu cation and as necessary, will publish cur- 
rent priorities m the Federal Register. The state educational agency may take these 
priorities into consideration for its guid/ince in the developTr:ent of its annual pro- 
gram of priorities and objectives under the annual prog^.^n ylan. Each state is re- 
quested in its annual program plan to indicate how the pr<>T'nt:s established by the 
state agency related (sic) to published national priorities. (Federal Register, April 23, 
1975, p. 17957) 

Included in these rules and i^gulations was an appendix entitled, Priorities for Programs 
of National Significance,*' which stated: 

Adult performance ^euel in olementation. By the end c'' *;ical year 1975, the Adult 
Performance Level (A^^L) test and objectives will be completed and available for im- 



Mn the third erlition of Educational Programs That Work (USOE, 1976), the APL study was described as "a 
research study lo identify and assess adult functional competency (literacy)." (p. 72) In the fourth edition of Educa- 
tional Programs Thit Work (USOE. 1977). the JDRP approval number and date remained the same as in the third 
edition, but the description of the APL study had changed. The study was now a ''competency-based system of 
education that combines Hlagnosis. prescription, teaching, evaluation and possible credentiallino of life-coping 
skills " (p. 6-3) 
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plementation. States should plan to utilize section 309 and other funds in support of 
projects to conduct a statewide literacy assessment and to develop instructional pro- 
grams designed to meet APL objectives. Also encouraged are staff development or 

teac.er competencies^ Careful attention should be paid to the avoidance of overlap 
17960r ' developments. {Federal Register, April 23, 1975. p 

Two points are noteworthy with regard to USOEs proclaiming this priority First it was 
issued long before the study's final report was completed. Second 'this prior ty gave Fedora 
sanction not only to the general notion of organizing adult education so as to meet the Hfe and 
occupational needs of adults with low levels of formal schooling, but to one pa ^^ubr 
manifestation of this general notion; namely, the APL approach. USOE enthusiasm ?or p o 
eTu'aLn " ' °" '^"^^ ^'^P'^'" °f APL Tdy on aduU 

Perhaps one might view the APL project not as a scientific inquiry, but as a verv effective 
exercise in marketing ideas for adult education. Indeed, given ALricarpassfon f^SZ 

fnTaToVfoVsuf '''' '''""^ mathratic'aT T^^^^^^^ 

indicators of success in life would appear to be a stroke of marketing genius. 

The notion of basing the APL study findings on a nationwide statistical survey also ora:,tIu 
enhanced its potential for garnering public attention. As Daniel Boorst n in The^^^^^^^^^ 
The Democratic Experience (1974). has written: • m /ne nmer^.ons. 

specialty. One by-product of democracy was an unprecedented popular diffusion of 
tt public'ml'd ""^"^ ^ '^'"'^ °' consciousness captured 

KotK "."""^^^ consciousness of the public and the American passion for worldlv success 
both help to explain why the remarkable conclusion of the APL study-that one ifth of U 1 
thet'fa'cTo ' -^°-P«t-t"— ceived such widespread attenSon But neUher' of 

these factors fully explains the irr^pact of APL on the world of adult education AftPrT thi 

stead " ^rK^lT'^l'^^ unsuccessful in markelg o"Lr of S enthu^^^^^^^ n 

atus oTadI basic*': '"r""* '""^^^^ °' '^^^ ^^"'^^ be'explained by consSg the 
status ot adult basic education programs in the United States. 

The Adult Education Act of 1966 emphasized "adult basic education'-defined as 
education for adults whose inability to speak, read or write the English lanquaqe qreatlv im 
pairs their ability to get or retain jobs commensurate with their real ^n,t^" Tr^^^^ \?' 
General. 1975) . One problem with fulfilling this mandate fthe wel -elSd actZt n^' 

?a'il°Cross'n97«f "^T e^ca ^ at^ i^^^^ 

Patricia Cross (1978). for example, cites data showing that participation rates in adult educa 

•Other Stated priorities dealt with dissemination of imorovcd DroaMmi:;.n^ r.r..f^ . * *u , , 

employees, s.aff developmen,, and experimental andTlnSon oro^c^ ^'^'^ 



the role of 

lion projects. 
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tion in 1975 ranged from 30 percent for adults v^ith 5 or more years of college, to 12 percent 
or high school graduates, to only 2 percent for those with an elementary education or less (0 
to 8 years of schooling). A 1975 review by the Comptroller General of the adult basic educa- 
tion program authorized by that legislation confirms this general condition. 

Only about one percent of the Adult Education program's estimated target popula- 
tion of 57 million adults (16 years of age or older and not enrolled in school who 
have not completed their secondary education) and four percent of the 15 million 
adults with less than eight years of school have participated in any given year. 

^i^' ^''^.'"L?^ Comptroller General recommended, among other things that 

the U.S. Office of Education: 

•emphasize recruiting and educating participants from the first priority group (adults 
functioning at the fourth grade level or below); 

•develop a system to identify potential benefits of special projects and to insure max- 
imum dissemination to. and adoption of their results by state and local management 
levels. 

107^?'"^? recommendations and USOE's agreement with them (Comptroller General 
, ,c^c T^?,""^^ *° understand why the APL study was greeted enthusiastically at 

USOE and why that agency promoted the APL approach even before the study's final report 
was finished. The APL study not only supplied dramatic evidence of the need for adult basic 
education, but also provided a framework for organizing adult education activities to respond 
to the need. 

in congressional hearings in 1976. Daniel Flood (D-Pa.). then chairperson of the House 
Appropriations Subcommittee on Labor and Health. Education, and Welfare, asked USOE of- 
ficials what they planned to do to resolve deficiencies identified by the APL study. Paul Delker 
director of USOE's Division of Adult Education, explained: 

...the basic purpose of the study was to define the educational fields of adults. And 
that study does, in the form of 65 objectives, identify the knowledges (sic) and skills 
which adults must have if they are going to function effectively. 

We met just last month with all of our state directors in Texas, with the (APL) project 
staff, in planning how the states will build curriculum and develop more effective 
systems based on this more accurate definition. The money which the Congress in 
1974 authorized for experimental demonstration authority at 15%, does give the 
resources to the states to take the ball and run with it. (U.S. Congress, 1976, 
p. 440) ^ 

USOE not only provided financial resources to the states to take the APL ball and run with 
it-vi« the priority placed on APL with respect to the section 309 experimental and 
demonstration monies, which in 1976 amounted to around $10 million-but also provided 
n.ore direct promotion of the APL. in 1977, for example, USOE sponsored regional 
workshops to introduce adult educators to the APL approach. Also, a number of adult 
educators met in Texas to develop curriculum materials to help implement the APL -.pproach. 
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But it was not just USOE promotion that made the APL approach attractive to adult 
educators. The APL seemed to organize adult education activities so as to overcome obstacles 
to participation by less well-educated individuals. As Kjell Rubenson (1978) observed: 

...available evidence suggests that the most powerful psychological impediment is 
the individual's belief that participation in adult education would not improve his 
general living situation or give him any advantages in the labor market. This attitude 
is often, especially among older people, linked to a fear of studying. One has 
learned that "education is not my cup of tea." In many cases, this is connected with 
a negative school experience. 

In this light, it becomes easier still to appreciate the attractiveness of the APL to adult 
educators. APL encouraged adult education to adopt a form quite different from the three R's 
orientation of traditional schooling and to do so in a way that seemed to promise adult learners 
both improvements in their general living situation and advantages in the labor market. Not 
surprisingly, these aspects of the APL approach are stressed in APL curriculum materials. 
Much of the APL curriculum development work has been done by the staff of the Adult Per- 
formance Level Project of the University of Texas at Austin— the same group that conducted 
the APL study. * Curriculum materials developed by the APL group are now published by 
Harcourt Brace Jovanovich as 'The APL Series" and subtitled *'Coping in Today's 
Society."* * The publisher's promotional material advises: 

Perhaps the most important thing to consider in judging the value of the APL Series 
is the content. Traditional skills like reading and computing are treated as the means 
to an end — rather than as ends in themselves. The life-coping information your 
adult learners will gain through these materials will serve them well long after they 
leave your classroom, (p. 7) 

When one looks into the sample of the APL series content provided in the promotional 
booklet, one finds a range of practical information dealing with everything from family 
budgeting to job finding and health care. This information is organized into the same five 
knowledge areas as the APL test (consumer economics, occupational knowledge, health, 
community resources, and government and law). However, the curriculum materials seem to 
reflect some very different assumptions about the nature and stability of adult competence 
from those undergirding the original APL study and tests. In the health unit of the APL series, 
for example, one lesson asks what adult learners would do, as parents, if they learned that 
their son had been cutting classes regularly, or that their 14-year-old daughter had been 
masturbating. 

The introduction to these "what would you do" situations advises that, "...there are no 
right or wrong answers. Everyone has to deal with a problem in his or her own way." This ad- 



' For an account of other efforts to develop curriculum materials appropriate to the APL approach, see Heller et al. , 
197H 

* 'These materials are divided into eight units; consumer economics I. II. and III; occupational knowledge; com- 
munity resources, health I and II. and government and law. Each unit contains a reading book, student workbook, 
te.Khing manual, and teacher's kit. with the full set of materials for all eight units priced at around $200. (Harcourt 
Brace Jovanovich. 1979) 
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vice seems entirely sensible in light of the criticisms of the APL study and test. Indeed, this 
disclaimer seems entirely appropriate to a host of "adult competence" problems-including 
whether radicals and trouble-makers should have the right to peaceful assembly, what Mary 
Dilly should do to make quick money, and what Esther Maxey should do with her gar- 
bage—but flies in the face of the assumption implicit in the multiple-choice format of the APL 
test that there are uniform right and wrong answers to such problems. 

The advice also brings us to what we see as the primary value of the APL approach to 
adult education. Simply put, the APL approach has helped diversify methods of organizing 
adult basic education. It need not be arranged entirely around the traditional three R's of 
schooling. Rather, it can be organized in terms of real experiences of adult learners. 

This view seems to be substantiated by the opinions of several adult educators with whom 
we have talked about their experiences with APL materials. One said, for example, that the 
materials serve as a supplementary source in planning lessons for adult learners around their 
own concerns, but not as a primary one. Another recounted that the APL life-skills approach 
has proven useful, but that the APL curriculum, based on the 65 APL objectives, has not been 
totally adopted. In sum, among the small and completely unsystematic sample of adult 
educators with whom we talked, none had adopted either the APL test or the curriculum 
materials in their entirety. Instead they were using them with other educational materials to 
broaden the base that they drew on to meet the diverse needs of adult learners. 

In sum, the rapid spread of the APL concept and the curriculum materials can be at- 
tributed to the convergence of a number of factors in the mid- 1970 s: 
•Its acceptance by the Joint Dissemination Review Panel. 

•USOE efforts to inform state adult education leaders of the results of the APL study 
and, via Federal funding, to encourage adoption of its objectives in adult basic 
education programs. 

•The recognition tha: the APL approach offered an attractive alternative to traditional 
ABE programs, which reached only a small proportion of the eligible population. 

•The development of curriculum materials that did not adhere to the assumptions of 
the original APL idea. 

•The fact that adult educators could adapt APL to their own needs. 

In these respects, the influence of the APL study seems to have been largely salutary. But 
these respects are iaigtly contrary to the narrow conception of competence embodied in the 
APL test itself —in the original Texas version and, to an even qreater extent, in the ACT instru- 
ment, which uses the multiple-choice format exclusively. So the APL enterprise seems to us 
to have prompted two different tendencies in adult basic education. On the one hand, it has 
helped to broaden conception? of how adu'' basic education can be organized and has en- 
riched the body of curriculum materials available to adult educators But on the other hand, it 
has served to promote a questionably nar.o. ' approach to the assessment of adult com- 
petence. 
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Areas for Further Study 

This APL story serves, vje think, to raise some larger questions about both the recent en- 
thusiasm for competency testing generally and the means by which educational ideas and in- 
novations are communicated to and influence educational endeavors. In the marketplace of 
educational ideas, hyperbole seems to have a permanent place . If the end results of a social in- 
quiry like the APL study are largely salutary— having produced some useful adult education 
curriculum materials and broadened conceptions of how adult education can be 
organized—the reader might wonder why we are so harsh in reviewing the scientific quality of 
that inquiry. To make our concern clear, let us once again cite Walter Lippman's words (Block 
and Dworkin, 1976), this time in paraphrase, about the possible abuse of intelligence tests. 

Though some of the developments flowing from the APL study may appear excellent, it is 
of the first importance that educators realize exactly what such improvements signify. For 
mischief will follow if there is confusion about the meaning of these reforms. If, for example, 
the impression takes root that the APL tests "scientifically" measure adult competence, then it 
would be a thousand times better if all the APL instruments were abandoned without warning. 
It is not possible, we think— again paraphrasing Lippman — to imagine a more contemptible 
proceeding than to confront an adult with a set of multiple-choice items and, after a bit of 
monkeying around with them, proclaim that person functionally incompetent. It would not 
only be a contemptible thing to do, it would be a crazy thing to do, because there is nothing in 
these tests to warrant a judgment of this kind. 

This leaves us with two sets of questions on the APL tests and curriculum materials and on 
adult basic education. It seems to us that far more should be learned about how the APL tests 
and materials are being used. Are the tests in fact being used to draw summary conclusions 
about an individual's overall competence? How do adult educators who use the tests and cur- 
riculum materials reconcile the apparent discrepancies between the tests' fixed specification ot 
what constitutes adult competence and the curriculum materials' recognition of legitimate alter- 
nate ways of solving life-skills problems in particular? 

We have not, in this brief review of the APL study and its progeny, been able to examine 
these questions in any depth, '^ jvertheless. we think that answers to them are of far more than 
merely academic interest. Mv/Jlung, for example, has already raised important questions 
about APL test use. In an article questioning the potential use of competency testing for unfa,f 
discrimination, he points out that one Florida school district has used the APL test as a basis for 
awarding students with a ''Certificate of Attendance" instead of a regular high school 
diploma— despite the fact that school officials would not guarantee that all the APL objectives 
would be taught in 12 yean of schooling (McClung, 1977). 

Beyond questions directed strictly at the APL study and its progeny lies another set of 
questions about the state of adult basic education in the United States. Indeed, we think these 
questions are far more important than those directed solely at the APL enterprise. For as we 
have tried to show in this brief paper, the public success of the APL endeavoi seems not to be 
explained by the scientific quality of the APL study nor even by USOE boosterism of it. Rather, 
its success and proliferation seem to be explained more by the state of adult basic education in 
this country. In this respect, it seems vitally important to explore other metaphors around 
which adult basic education activities might be organized. How, for example, might vocational 




training for adults be tied more closely with adult basic education programs? How does the 
APL approach to adult basic education relate to other forms of adult education? 

education programs aimed at adults' earning the General Educational Development 
(GED) degree, for example, tend to serve adults with more formal schooling (5 to 12 years) 
than those in adult basic education. The GED-oriented programs typically focus more on the 
three R s of traditional schooling than on life-skills. What is the relationship between these two 
approaches to adult education? To what extent, if any. are the "life-skills" approach in adult 
basic education (exemplified in the APL) and the "school-skills" approach in adult general 
education (exemplified in the GED) leading to a stratified system of adult education^ How 
does the acquisition of skills in these programs-be they life- or school-oriented-relate to the 
credentialling role of adult education? 

These are some of the questions that this review of the APL enterprise has raised in our 
minds. We realize that there will likely be no clear-cut answers to many of ih«m. Attending to 
them is. nevertheless, of considerable importance. For if we do not. it may happen that the 
tendency in the APL enterprise toward an enlarging vision of what adult basic education can 
be for diverse types of adult learners may inadvertently be lost to the other ;endency in that 
enterprise-a narrow, fixed conception of "adult competence" as the goal of adult basic 
education, and an equally narrow perspective on how such competence can be assessed. 
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